You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/04/12 16:16:58 UTC

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b84) - Build # 5128 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5128/
Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:42963/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:42963/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([638BE3BDEF103906:E26D6DA5984F593A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([638BE3BDEF103906:E26D6DA5984F593A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9137 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.037; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.041; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.042; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.042; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.143; org.apache.solr.cloud.ZkTestServer; start zk server on port:42021
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.144; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.388; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@569f86b5 name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.388; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.388; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.394; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.395; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@58587216 name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.395; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.395; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.398; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.401; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.402; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.404; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.405; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.408; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.409; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.411; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.412; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.414; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.414; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.416; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.416; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.419; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.419; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.421; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.422; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.424; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.424; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.428; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.428; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.489; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.506; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:54774
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.506; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.507; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.507; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.507; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.507; org.apache.solr.core.CoreContainer; New CoreContainer 1264331316
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.508; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.508; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.525; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.526; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.526; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.526; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.526; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.527; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.527; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.527; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.528; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.528; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.533; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.549; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42021/solr
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.549; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.550; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.552; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1fa9483c name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.552; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.554; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.557; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.558; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f505b6b name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.558; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.561; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.564; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.567; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.568; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54774_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.569; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54774_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.571; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.579; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.582; org.apache.solr.cloud.Overseer; Overseer (id=89507464416133123-127.0.0.1:54774_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.586; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.589; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.589; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.591; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.593; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.595; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.597; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.597; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.597; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.597; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.599; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.599; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.599; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.619; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.644; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.654; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.659; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.974; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.983; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:19.985; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.004; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.009; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.014; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:20.016; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:20.016; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.017; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:20.018; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:20.019; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.019; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.020; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365775519433/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.020; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f53bb47
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.021; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.021; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.022; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:20.022; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.023; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.025; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@331c503 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b155d98; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.026; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.029; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.029; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.030; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.031; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.031; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.032; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.032; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.033; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.033; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.038; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.042; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@38bac1f6 main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.042; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.043; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.043; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.047; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@38bac1f6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.049; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:20.049; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:21.100; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:21.101; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:54774_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54774",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:21.101; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:21.102; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:21.108; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.052; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.052; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54774 collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.054; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.066; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.070; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.071; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.071; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:54774/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.071; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.071; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:54774/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.072; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54774/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.072; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.615; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.628; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.635; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54774/collection1/ and leader is http://127.0.0.1:54774/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.635; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54774
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.636; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.636; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.636; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.640; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.642; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.642; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.643; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.648; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.650; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.652; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@9fbdf8c name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.653; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.656; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.660; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.727; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.730; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:38319
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.731; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.731; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.731; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.731; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.732; org.apache.solr.core.CoreContainer; New CoreContainer 1936127572
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.732; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.732; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.751; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.756; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.774; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42021/solr
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.774; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.775; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.777; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7a74d3c6 name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.778; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.781; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.784; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.786; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@34c8f1d8 name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.787; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:22.793; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.799; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38319_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.801; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:38319_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.805; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.808; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.808; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.810; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.817; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.817; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.818; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.819; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.821; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.822; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.822; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.863; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.900; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.902; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:23.906; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.136; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.137; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:54774_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54774",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.141; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.141; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.141; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.240; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.246; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.248; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.268; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.273; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.278; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:24.280; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:24.281; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.281; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:24.283; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:24.284; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.284; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.285; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.285; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f53bb47
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.286; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.286; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.287; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:24.287; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.288; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.290; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1bf264ac lockFactory=org.apache.lucene.store.NativeFSLockFactory@66828b63; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.290; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.294; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.294; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.295; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.296; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.297; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.297; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.297; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.298; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.299; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.303; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.305; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@551153e main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.305; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.306; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.306; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.311; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@551153e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.314; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:24.315; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.655; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.657; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38319",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.657; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.658; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.666; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.666; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:25.666; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.317; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.317; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:38319 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.319; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.332; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.336; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.337; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.337; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:38319/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.337; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.338; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:38319/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.338; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:38319/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:26.338; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.175; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.189; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.189; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.189; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.203; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38319/collection1/ and leader is http://127.0.0.1:38319/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.203; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38319
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.203; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.203; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.204; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.207; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.209; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.209; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.210; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.273; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.276; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:42963
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.277; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.278; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.279; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.279; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.280; org.apache.solr.core.CoreContainer; New CoreContainer 1593585450
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.280; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.281; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.309; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.309; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.310; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.310; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.310; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.310; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.311; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.311; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.311; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.312; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.316; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.338; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42021/solr
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.338; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.339; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.342; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5284639a name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.342; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.345; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.350; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.353; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4e273720 name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.353; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:27.360; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.365; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42963_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.368; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:42963_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.373; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.373; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.373; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.374; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.374; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.376; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.377; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.383; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.383; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.384; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.384; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.386; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.387; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.388; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.415; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.450; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.452; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.457; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.700; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.701; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38319",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.777; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.785; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.787; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.807; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.813; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.818; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:28.820; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:28.820; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.821; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:28.823; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:28.823; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.824; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.824; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365775527215/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.825; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f53bb47
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.825; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.827; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.827; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:28.827; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.828; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.830; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@7e431362 lockFactory=org.apache.lucene.store.NativeFSLockFactory@67586cd4; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.831; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.834; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.834; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.835; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.836; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.837; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.837; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.838; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.839; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.839; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.843; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.845; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4cc06597 main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.845; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.846; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.846; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.852; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4cc06597 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.855; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:28.855; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.212; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.213; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:42963_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42963",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.214; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.214; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.222; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.223; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.223; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.223; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.857; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.858; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:42963 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.859; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.871; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.875; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.876; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.876; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:42963/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.876; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.877; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:42963/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.877; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:42963/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:30.877; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.731; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.747; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.747; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.747; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.747; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.790; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:42963/collection1/ and leader is http://127.0.0.1:42963/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.791; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42963
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.791; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.791; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.792; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.794; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.797; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.797; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.798; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.867; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.871; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:42516
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.872; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.872; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.873; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.873; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.874; org.apache.solr.core.CoreContainer; New CoreContainer 1237225177
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.875; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.875; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.896; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.896; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.896; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.896; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.897; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.897; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.897; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.898; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.898; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.898; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.903; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.926; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42021/solr
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.926; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.928; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.931; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@43e66f74 name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.931; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.934; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.940; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.942; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7718dd2d name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.943; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:31.950; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.956; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42516_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.959; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:42516_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.963; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.964; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.965; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.964; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.965; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.965; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.967; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.969; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.969; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.974; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.975; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.976; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.976; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.978; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.979; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:32.979; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.011; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.050; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.052; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.058; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.257; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.258; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:42963_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42963",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.263; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.264; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.264; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.264; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.264; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.400; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.406; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.408; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.430; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.434; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.437; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:33.439; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:33.439; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.440; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:33.442; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:33.442; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.442; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.443; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365775531803/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.443; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f53bb47
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.443; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.444; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.444; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:33.444; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.444; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.446; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@427b6afa lockFactory=org.apache.lucene.store.NativeFSLockFactory@59e81df2; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.446; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.448; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.448; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.448; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.449; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.449; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.449; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.449; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.450; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.450; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.452; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.454; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7ec90d19 main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.454; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.455; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.455; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.461; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7ec90d19 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.464; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:33.464; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.770; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.772; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:42516_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42516",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.772; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.772; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.781; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.781; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.781; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.781; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:34.781; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.466; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.467; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:42516 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.473; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:42516/collection1/ and leader is http://127.0.0.1:38319/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.473; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42516
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.473; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.474; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.474; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.475; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.476; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.476; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.476; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.478; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.479; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.478; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.479; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.486; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.549; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.552; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:47274
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.553; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.554; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.554; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.555; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.555; org.apache.solr.core.CoreContainer; New CoreContainer 759628847
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.556; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.557; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.576; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.577; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.577; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.577; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.577; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.578; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.578; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.578; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.578; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.579; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.583; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.607; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42021/solr
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.607; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.609; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.612; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@42abec55 name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.613; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.616; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.621; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.623; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@75529ea9 name:ZooKeeperConnection Watcher:127.0.0.1:42021/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.624; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:35.631; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.290; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.291; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:42516_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42516",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.300; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.300; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.300; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.300; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.300; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.300; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.486; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.487; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={core=collection1&coreNodeName=4&action=PREPRECOVERY&nodeName=127.0.0.1:42516_&wt=javabin&state=recovering&checkLive=true&version=2&onlyIfLeader=true} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.637; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47274_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.639; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:47274_
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.644; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.644; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.644; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.645; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.645; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.646; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.647; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.647; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.647; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.654; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.655; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.656; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.656; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.659; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.659; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.660; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.702; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.741; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.744; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:36.749; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.086; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.091; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.093; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.112; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.116; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.120; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:37.122; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:37.122; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.123; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:37.125; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:37.125; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.126; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.126; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365775535484/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.126; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f53bb47
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.127; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.128; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.128; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:37.129; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.129; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.132; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@143b4e8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7de43bcf; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.132; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.135; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.136; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.137; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.138; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.138; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.139; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.139; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.140; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.141; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.145; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.149; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@60167762 main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.149; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.150; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.151; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.155; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@60167762 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.158; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.158; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.809; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.811; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:47274_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:47274",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.811; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.811; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.819; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.819; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.819; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.819; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.819; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:37.819; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.160; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.161; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:47274 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.167; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:47274/collection1/ and leader is http://127.0.0.1:42963/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.167; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47274
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.168; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.168; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.169; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.170; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.170; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.170; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.170; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.172; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.173; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.172; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.173; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.177; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.177; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.178; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.182; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.183; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.184; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.185; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.187; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.187; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.190; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.192; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.241; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.292; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.295; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.298; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.488; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:38319/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.488; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:42516 START replicas=[http://127.0.0.1:38319/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:38.489; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.490; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.490; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.490; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.490; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.490; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:38319/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.491; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.494; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={wt=javabin&getVersions=100&distrib=false&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.495; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.510; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1bf264ac lockFactory=org.apache.lucene.store.NativeFSLockFactory@66828b63; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.511; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.512; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1bf264ac lockFactory=org.apache.lucene.store.NativeFSLockFactory@66828b63; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1bf264ac lockFactory=org.apache.lucene.store.NativeFSLockFactory@66828b63; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.512; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.513; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@e682c25 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.513; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.514; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit_end_point=true&wt=javabin&version=2&openSearcher=false&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 19
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.516; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.517; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.522; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.523; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=5 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.524; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.524; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.524; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.526; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=filelist&wt=javabin&generation=2&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.527; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.529; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index.20130412110538527
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.530; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@22f995cf lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cfd1384) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.533; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&wt=filestream&checksum=true&generation=2&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.534; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.536; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.537; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.539; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@427b6afa lockFactory=org.apache.lucene.store.NativeFSLockFactory@59e81df2; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@427b6afa lockFactory=org.apache.lucene.store.NativeFSLockFactory@59e81df2; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.540; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.541; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.541; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@21c52714 main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.543; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@21c52714 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.544; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index.20130412110538527 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index.20130412110538527;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.544; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index.20130412110538527
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.544; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty3/index.20130412110538527
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.545; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.545; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.545; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.546; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.548; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.660; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.666; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.667; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.702; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.708; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.713; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:38.716; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:38.717; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.717; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:38.720; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:38.720; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.721; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.722; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365775522660/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.722; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f53bb47
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.723; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.724; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.725; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:38.725; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.726; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.729; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@4f5f7546 lockFactory=org.apache.lucene.store.NativeFSLockFactory@74e473c3; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.729; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.733; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.733; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.734; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.735; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.736; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.737; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.737; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.738; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.739; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.743; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.745; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1ae479ac main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.746; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.746; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.746; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.749; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@1ae479ac main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:38.750; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.326; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.327; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:47274_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:47274",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.333; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:42516_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:42516",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.337; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38319",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.338; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.338; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.367; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.367; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.368; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.367; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.367; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.367; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.753; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.753; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:38319 collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.754; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.763; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.767; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.767; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.767; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:38319/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.767; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.768; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:38319/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.768; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:38319/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:39.768; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.178; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.179; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={core=collection1&coreNodeName=5&action=PREPRECOVERY&nodeName=127.0.0.1:47274_&wt=javabin&state=recovering&checkLive=true&version=2&onlyIfLeader=true} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.883; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.900; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.900; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.900; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.899; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.929; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38319/onenodecollectioncore/ and leader is http://127.0.0.1:38319/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.929; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:38319
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.930; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.931; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.934; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.936; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={action=CREATE&collection=onenodecollection&wt=javabin&numShards=1&version=2&roles=none&name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365775519042/onenodecollection} status=0 QTime=2754 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.937; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:40.938; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:41.941; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.180; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:42963/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.180; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:47274 START replicas=[http://127.0.0.1:42963/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:42.181; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.181; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.182; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.182; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.182; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.182; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:42963/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.183; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.191; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={wt=javabin&getVersions=100&distrib=false&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.193; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.195; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@7e431362 lockFactory=org.apache.lucene.store.NativeFSLockFactory@67586cd4; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.196; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.197; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@7e431362 lockFactory=org.apache.lucene.store.NativeFSLockFactory@67586cd4; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@7e431362 lockFactory=org.apache.lucene.store.NativeFSLockFactory@67586cd4; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.198; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.198; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2fd03079 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.199; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.200; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit_end_point=true&wt=javabin&version=2&openSearcher=false&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.201; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.201; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.203; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.204; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.204; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.204; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.205; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.207; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=filelist&wt=javabin&generation=2&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.208; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.209; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index.20130412110542208
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.210; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@35420978 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17e975da) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.212; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&wt=filestream&checksum=true&generation=2&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.214; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.215; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.215; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.217; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@143b4e8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7de43bcf; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@143b4e8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7de43bcf; maxCacheMB=0.0263671875 maxMergeSizeMB=0.310546875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.218; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.218; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.219; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1cb923e8 main
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.220; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1cb923e8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.221; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index.20130412110542208 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index.20130412110542208;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.222; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index.20130412110542208
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.222; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/jetty4/index.20130412110542208
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.222; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.222; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.223; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.223; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.225; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.410; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.412; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:38319__onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38319",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.418; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:47274_",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:47274",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.427; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.944; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.946; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.946; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.980; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.982; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15cd45a7 name:ZooKeeperConnection Watcher:127.0.0.1:42021 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:42.982; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507464416133130-127.0.0.1:42516_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507464416133128-127.0.0.1:42963_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507464416133132-127.0.0.1:47274_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507464416133123-127.0.0.1:54774_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507464416133126-127.0.0.1:38319_-n_0000000001 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89507464416133123-127.0.0.1:54774_-n_0000000000"}
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:47274_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:42963_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:38319_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:42516_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:54774_ (0)
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:42963_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:42963"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38319"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89507464416133128-3-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89507464416133132-5-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89507464416133130-4-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89507464416133126-2-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "router":"compositeId",
[junit4:junit4]   1>          "configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"onenodecollectioncore",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38319"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89507464416133126-127.0.0.1:38319__onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54774_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54774"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89507464416133123-1-n_0000000000 (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "2":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38319",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "4":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:42516_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:42516",
[junit4:junit4]   1>                   "shard":"shard1"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "3":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:42963_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:42963",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "5":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:47274_",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:47274",
[junit4:junit4]   1>                   "shard":"shard2"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:38319__onenodecollectioncore":{
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38319_",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38319",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:54774_",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:54774",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.074; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 54774
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.076; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=1264331316
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.937; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.939; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:54774_",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54774",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.957; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.957; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.957; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.957; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:43.957; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.079; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.079; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.084; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@804a2c6
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.089; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.090; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.090; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.091; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.092; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.093; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.093; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.094; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.094; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.095; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365775519042/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.096; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89507464416133123-127.0.0.1:54774_-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.098; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.098; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.098; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:45.100; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.100; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> WARN  - 2013-04-12 14:05:45.100; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.101; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.101; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.103; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.103; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.106; org.apache.solr.cloud.Overseer; Overseer (id=89507464416133126-127.0.0.1:38319_-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-12 14:05:45.114; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creati

[...truncated too long message...]

4:junit4]   1> INFO  - 2013-04-12 14:06:46.063; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.064; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.064; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.065; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.064; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:46593__unloadcollection4",
[junit4:junit4]   1>   "core":"unloadcollection4",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46593",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "node_name":"127.0.0.1:46593_",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "collection":"unloadcollection"}
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.067; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.067; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.068; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859/1365775491738unloadcollection_4n/index.20130412200504399 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859/1365775491738unloadcollection_4n/index.20130412200504399;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.068; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859/1365775491738unloadcollection_4n/index.20130412200504399
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.068; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859/1365775491738unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859/1365775491738unloadcollection_4n;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.069; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859/1365775491738unloadcollection_4n
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.070; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.070; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.073; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.075; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.096; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.150; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.154; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:53376 53376
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.256; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1cb91da7 name:ZooKeeperConnection Watcher:127.0.0.1:53376/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.256; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365775467859
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=638BE3BDEF103906 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=el_GR -Dtests.timezone=Asia/Qyzylorda -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  138s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([638BE3BDEF103906:E26D6DA5984F593A]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:46.278; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 138438 T1385 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-12 14:06:46.370; org.apache.solr.cloud.OverseerCollectionProcessor; Overseer cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-12 14:06:47.371; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 14:06:47.371; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-12 14:06:47.372; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-12 14:06:47.372; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=el_GR, timezone=Asia/Qyzylorda
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=23473472,total=206876672
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrDeletionPolicy2, ChaosMonkeyNothingIsSafeTest, DistributedSpellCheckComponentTest, TestStressVersions, TestSearchPerf, QueryParsingTest, PrimUtilsTest, DateFieldTest, SolrCoreTest, TestCharFilters, StatelessScriptUpdateProcessorFactoryTest, ShardSplitTest, TestRemoteStreaming, BasicFunctionalityTest, LukeRequestHandlerTest, SliceStateTest, TestDocSet, PrimitiveFieldTypeTest, OverseerTest, TestExtendedDismaxParser, AutoCommitTest, TestFunctionQuery, TestClassNameShortening, LoggingHandlerTest, SolrInfoMBeanTest, AnalysisAfterCoreReloadTest, TestLRUCache, RegexBoostProcessorTest, TestFieldTypeResource, ZkCLITest, CircularListTest, UpdateRequestProcessorFactoryTest, TestRandomDVFaceting, TestIBSimilarityFactory, DirectUpdateHandlerOptimizeTest, TestSchemaVersionResource, QueryElevationComponentTest, MinimalSchemaTest, BadComponentTest, TestReversedWildcardFilterFactory, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 139.73s, 1 test, 1 failure <<< FAILURES!

[...truncated 649 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 40 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_17) - Build # 5135 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5135/
Java: 32bit/jdk1.7.0_17 -client -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
expected:<1365811986307> but was:<1365811986285>

Stack Trace:
java.lang.AssertionError: expected:<1365811986307> but was:<1365811986285>
	at __randomizedtesting.SeedInfo.seed([6D5F0C897FA0F6EA:B6F40C4F7A889F59]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.handler.TestReplicationHandler.assertVersions(TestReplicationHandler.java:871)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:735)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9374 lines...]
[junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.392; org.apache.solr.SolrTestCaseJ4; ###Starting doTestBackup
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.396; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.398; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:44133
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.399; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.399; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.399; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.400; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.400; org.apache.solr.core.CoreContainer; New CoreContainer 23295590
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.401; org.apache.solr.core.CoreContainer$Initializer; no solr.xml found. using default old-style solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.401; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.402; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.423; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.424; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.424; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.425; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.425; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.426; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.426; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.427; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.427; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.428; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.436; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.451; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.452; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.479; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.512; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.513; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.515; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.527; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.529; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.529; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/, dataDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.529; org.apache.solr.core.SolrCore; JMX monitoring not detected for core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.530; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.530; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.531; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index/
[junit4:junit4]   1> WARN  - 2013-04-13 00:12:32.531; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.531; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.532; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@11d0882 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1daefb4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.533; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.534; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.534; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.534; org.apache.solr.core.RequestHandlers; created defaults: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.534; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.535; org.apache.solr.core.RequestHandlers; created lazy: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.535; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.537; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.540; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@360c63 main
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.540; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.540; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.541; org.apache.solr.handler.ReplicationHandler; Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.541; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.541; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.541; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@360c63 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.542; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.542; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.543; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.548; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.549; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:59445
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.550; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.551; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.551; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.551; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.552; org.apache.solr.core.CoreContainer; New CoreContainer 1240568
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.552; org.apache.solr.core.CoreContainer$Initializer; no solr.xml found. using default old-style solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.553; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.553; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.570; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.571; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.571; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.572; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.573; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.573; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.574; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.574; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.575; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.575; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.582; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.600; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.600; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.626; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.659; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.660; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.662; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.673; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.675; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.675; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/, dataDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.675; org.apache.solr.core.SolrCore; JMX monitoring not detected for core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.675; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.676; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.677; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/index/
[junit4:junit4]   1> WARN  - 2013-04-13 00:12:32.677; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.678; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.678; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@296fc8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a1cb73),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.679; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.680; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.680; org.apache.solr.core.RequestHandlers; created defaults: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.680; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.680; org.apache.solr.core.RequestHandlers; created lazy: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.681; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.681; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.682; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.684; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@129bac1 main
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.684; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.685; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.686; org.apache.solr.handler.SnapPuller; Poll Scheduled at an interval of 1000ms
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.687; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.687; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@129bac1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.687; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.688; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.689; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.716; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=23295590
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.719; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@cb4162
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.720; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.721; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.722; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.724; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.725; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.726; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.727; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.728; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.729; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.730; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.731; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.786; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.790; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:59868
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.791; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.792; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.793; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.794; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.794; org.apache.solr.core.CoreContainer; New CoreContainer 5066367
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.795; org.apache.solr.core.CoreContainer$Initializer; no solr.xml found. using default old-style solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.796; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.797; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.828; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.829; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.829; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.830; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.830; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.830; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.831; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.831; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.832; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.832; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.838; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.852; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.853; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.885; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.950; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.951; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.954; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.967; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.968; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.969; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/, dataDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.969; org.apache.solr.core.SolrCore; JMX monitoring not detected for core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.969; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.970; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.970; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index/
[junit4:junit4]   1> WARN  - 2013-04-13 00:12:32.970; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.971; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.972; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1dd3080 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ae9d12),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.972; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.973; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.973; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.974; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.975; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.977; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1f8c3f2 main
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.977; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.978; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.978; org.apache.solr.handler.ReplicationHandler; Replication enabled for following config files: schema-replication2.xml:schema.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.978; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.979; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.979; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1f8c3f2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.979; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.980; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.981; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.992; org.apache.solr.update.DirectUpdateHandler2; [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.994; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1dd3080 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ae9d12),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.995; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.996; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 4
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:32.999; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 1
[junit4:junit4]   1> ERROR - 2013-04-13 00:12:33.001; org.apache.solr.handler.SnapPuller; Master at: http://127.0.0.1:44133/solr is not available. Index fetch failed. Exception: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:44133/solr
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.001; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.004; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.007; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.009; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.012; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.015; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.018; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.020; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.023; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.026; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.028; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.031; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.034; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.037; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.039; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.041; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.043; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.046; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.048; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.051; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.054; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.056; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.058; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.061; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.063; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.066; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.068; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.070; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.073; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.075; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.077; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.080; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.082; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.085; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.088; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.090; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.092; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.095; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.097; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.100; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.102; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.105; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.107; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.109; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.112; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.114; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.117; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.121; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.123; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.126; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.129; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.132; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.134; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.137; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.140; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.143; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.146; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.148; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.151; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.153; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.156; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.159; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.161; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.164; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.167; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.170; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.173; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.176; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.179; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.182; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.185; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.187; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.189; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.191; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.194; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.196; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.198; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.200; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.203; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.205; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.207; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.209; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.211; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.213; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.216; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.218; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.220; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.223; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.225; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.228; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.230; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.233; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.236; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.238; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.241; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.244; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.247; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.250; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.253; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.255; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.258; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.261; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.264; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.267; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.270; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.273; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.276; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.279; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.281; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.284; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.287; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.290; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.293; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.296; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.299; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.302; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.304; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.307; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.310; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.312; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.315; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.319; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.322; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.324; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.326; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.328; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.330; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.332; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.334; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.336; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.338; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.340; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.342; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.344; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.346; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.348; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.350; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.352; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.354; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.356; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.358; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.360; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.362; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.364; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.366; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.368; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.370; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.372; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.373; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.375; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.377; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.379; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.381; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.383; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.385; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.387; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.390; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.392; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.394; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.397; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.400; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.402; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.405; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.408; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.411; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.413; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.416; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.419; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.422; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.424; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.426; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.428; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.430; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.432; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.434; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.436; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.438; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.440; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.442; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.444; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.446; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.448; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.450; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.452; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.454; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.456; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.458; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.460; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.463; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.465; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.467; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.469; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.471; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.473; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.475; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.477; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.479; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.481; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.483; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.485; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.487; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.489; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.491; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.493; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.495; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.497; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.499; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[207]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.501; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[208]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.503; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[209]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.505; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[210]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.507; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[211]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.509; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[212]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.512; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[213]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.514; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[214]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.516; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[215]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.518; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[216]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.520; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[217]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.522; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[218]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.524; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[219]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.526; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[220]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.528; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[221]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.530; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[222]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.532; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[223]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.534; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[224]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.536; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[225]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.538; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[226]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.540; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[227]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.542; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[228]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.544; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[229]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.547; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[230]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.549; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[231]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.551; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[232]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.553; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[233]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.556; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[234]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.558; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[235]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.560; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[236]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.562; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[237]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.564; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[238]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.567; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[239]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.583; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[240]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.586; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[241]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.588; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[242]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.590; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[243]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.592; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[244]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.595; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[245]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.597; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[246]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.599; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[247]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.601; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[248]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.603; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[249]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.605; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[250]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.607; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[251]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.610; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[252]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.612; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[253]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.614; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[254]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.616; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[255]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.618; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[256]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.620; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[257]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.622; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[258]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.624; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[259]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.627; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[260]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.628; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[261]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.630; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[262]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.632; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[263]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.634; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[264]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.636; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[265]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.638; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[266]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.640; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[267]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.642; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[268]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.644; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[269]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.646; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[270]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.648; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[271]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.650; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[272]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.652; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[273]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.654; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[274]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.656; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[275]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.658; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[276]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.660; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[277]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.662; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[278]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.664; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[279]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.666; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[280]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.668; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[281]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.670; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[282]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.672; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[283]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.674; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[284]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.676; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[285]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.678; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[286]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.680; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[287]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.683; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[288]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.685; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[289]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.687; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[290]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.689; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[291]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.692; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[292]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.694; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[293]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.696; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[294]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.698; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[295]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.701; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[296]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.703; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[297]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.705; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[298]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.707; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[299]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.710; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[300]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.712; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[301]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.714; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[302]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.716; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[303]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.718; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[304]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.720; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[305]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.722; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[306]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.725; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[307]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.727; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[308]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.729; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[309]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.731; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[310]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.733; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[311]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.735; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[312]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.737; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[313]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.739; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[314]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.742; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[315]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.744; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[316]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.747; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[317]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.749; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[318]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.752; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[319]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.755; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[320]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.758; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[321]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.760; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[322]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.763; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[323]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.765; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[324]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.767; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[325]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.769; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[326]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.771; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[327]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.773; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[328]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.775; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[329]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.777; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[330]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.778; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[331]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.780; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[332]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.782; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[333]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.784; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[334]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.786; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[335]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.788; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[336]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.790; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[337]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.792; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[338]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.794; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[339]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.795; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[340]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.797; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[341]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.799; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[342]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.801; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[343]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.803; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[344]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.805; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[345]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.807; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[346]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.809; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[347]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.811; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[348]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.812; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[349]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.814; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[350]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.816; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[351]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.818; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[352]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.820; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[353]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.822; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[354]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.824; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[355]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.826; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[356]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.827; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[357]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.829; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[358]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.831; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[359]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.833; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[360]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.835; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[361]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.837; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[362]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.839; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[363]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.841; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[364]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.843; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[365]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.845; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[366]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.847; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[367]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.849; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[368]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.851; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[369]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.853; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[370]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.855; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[371]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.857; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[372]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.859; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[373]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.861; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[374]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.863; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[375]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.865; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[376]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.866; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[377]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.868; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[378]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.870; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[379]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.872; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[380]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.874; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[381]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.876; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[382]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.879; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[383]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.881; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[384]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.883; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[385]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.885; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[386]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.887; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[387]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.889; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[388]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.891; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[389]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.893; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[390]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.896; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[391]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.898; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[392]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.900; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[393]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.902; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[394]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.904; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[395]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.906; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[396]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.908; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[397]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.910; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[398]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.912; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[399]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.914; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[400]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.916; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[401]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.918; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[402]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.920; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[403]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.922; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[404]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.925; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[405]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.927; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[406]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.929; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[407]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.931; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[408]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.934; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[409]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.936; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[410]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.938; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[411]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.940; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[412]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.942; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[413]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.945; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[414]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.947; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[415]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.949; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[416]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.951; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[417]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.953; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[418]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.956; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[419]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.958; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[420]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.960; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[421]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.962; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[422]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.964; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[423]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.966; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[424]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.969; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[425]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.971; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[426]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.973; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[427]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.975; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[428]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.977; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[429]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.980; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[430]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.982; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[431]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.984; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[432]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.986; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[433]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.988; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[434]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.990; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[435]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.992; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[436]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.994; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[437]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.996; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[438]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:33.998; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[439]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.000; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[440]} 0 0
[junit4:junit4]   1> ERROR - 2013-04-13 00:12:34.001; org.apache.solr.handler.SnapPuller; Master at: http://127.0.0.1:44133/solr is not available. Index fetch failed. Exception: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:44133/solr
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.002; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[441]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.004; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[442]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.006; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[443]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.008; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[444]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.010; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[445]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.012; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[446]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.014; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[447]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.016; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[448]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.018; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[449]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.020; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[450]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.022; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[451]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.024; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[452]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.026; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[453]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.028; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[454]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.030; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[455]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.032; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[456]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.034; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[457]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.036; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[458]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.038; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[459]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.040; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[460]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.042; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[461]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.044; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[462]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.046; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[463]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.047; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[464]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.049; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[465]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.051; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[466]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.053; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[467]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.055; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[468]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.058; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[469]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.060; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[470]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.062; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[471]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.064; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[472]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.066; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[473]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.068; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[474]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.070; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[475]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.072; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[476]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.074; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[477]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.076; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[478]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.078; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[479]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.080; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[480]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.083; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[481]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.085; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[482]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.087; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[483]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.089; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[484]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.091; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[485]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.093; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[486]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.095; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[487]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.097; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[488]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.099; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[489]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.101; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[490]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.103; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[491]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.105; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[492]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.107; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[493]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.109; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[494]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.111; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[495]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.113; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[496]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.115; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[497]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.117; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[498]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.119; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.125; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1dd3080 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ae9d12),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1dd3080 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ae9d12),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.125; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[_0.fnm, _0_Lucene41_0.doc, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.126; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1b98ae8 main
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.127; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.127; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1b98ae8 main{StandardDirectoryReader(segments_2:4:nrt _0(5.0):C499)}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.128; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.131; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.135; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=backup} status=0 QTime=5 
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.135; org.apache.solr.handler.SnapShooter; Creating backup snapshot...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:34.335; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
[junit4:junit4]   1> ERROR - 2013-04-13 00:12:35.001; org.apache.solr.handler.SnapPuller; Master at: http://127.0.0.1:44133/solr is not available. Index fetch failed. Exception: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:44133/solr
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.341; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.341; org.apache.solr.handler.SnapShooter; Creating backup snapshot...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.341; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=backup} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.543; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.546; org.apache.solr.SolrTestCaseJ4; ###Ending doTestBackup
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.570; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=5066367
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.572; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1822cf1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.573; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=499,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.574; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.574; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.574; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.576; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.576; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.577; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.577; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.577; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.578; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952393/master/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.579; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.653; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=1240568
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.655; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1c0d44b
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.656; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.656; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.657; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.657; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.657; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.658; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.658; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.659; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.659; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.660; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811952545/slave/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.660; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.719; org.apache.solr.SolrTestCaseJ4; ###Starting doTestIndexAndConfigAliasReplication
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.721; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.723; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:58571
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.724; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.724; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.725; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.725; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.725; org.apache.solr.core.CoreContainer; New CoreContainer 18265386
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.726; org.apache.solr.core.CoreContainer$Initializer; no solr.xml found. using default old-style solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.726; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.727; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.748; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.749; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.750; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.751; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.752; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.759; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.773; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.774; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.801; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.872; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.873; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.875; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.891; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.893; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.893; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/, dataDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/data/
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.894; org.apache.solr.core.SolrCore; JMX monitoring not detected for core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.894; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.896; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.896; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/data/index/
[junit4:junit4]   1> WARN  - 2013-04-13 00:12:35.896; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.897; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955719/master/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.897; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2585b6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8ce8d9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.898; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.898; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.899; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.899; org.apache.solr.core.RequestHandlers; created defaults: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.899; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.900; org.apache.solr.core.RequestHandlers; created lazy: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.900; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.903; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.905; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@b11ed2 main
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.905; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.905; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.906; org.apache.solr.handler.ReplicationHandler; Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.906; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.906; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.906; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@b11ed2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.907; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.908; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.908; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.914; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.917; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:58155
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.918; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.918; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.919; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.919; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.920; org.apache.solr.core.CoreContainer; New CoreContainer 14731615
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.920; org.apache.solr.core.CoreContainer$Initializer; no solr.xml found. using default old-style solr.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.921; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.921; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.938; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.939; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.939; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.940; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.940; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.940; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.941; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.941; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.942; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.942; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.948; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.963; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.963; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:35.997; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.030; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.031; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.033; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.044; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.045; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.046; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/, dataDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/data/
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.046; org.apache.solr.core.SolrCore; JMX monitoring not detected for core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.046; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.047; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.047; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/data/index/
[junit4:junit4]   1> WARN  - 2013-04-13 00:12:36.048; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.048; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811955912/slave/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.049; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f479c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@148c62a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.049; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.050; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.050; org.apache.solr.core.RequestHandlers; created defaults: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.051; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.051; org.apache.solr.core.RequestHandlers; created lazy: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.051; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.051; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.053; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.055; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@c60293 main
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.055; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.055; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.056; org.apache.solr.handler.SnapPuller; Poll Scheduled at an interval of 1000ms
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.056; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.056; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@c60293 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.057; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.058; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.058; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.065; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.068; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2585b6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8ce8d9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.068; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.069; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.071; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.073; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.074; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.076; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.078; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.080; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.082; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.084; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.086; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.088; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.090; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.092; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.093; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.095; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.097; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.099; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.101; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.103; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.105; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.107; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.109; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.111; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.113; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.115; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.117; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.119; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.121; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.122; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.124; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.126; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.128; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.130; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.132; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.134; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.136; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.138; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.140; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.142; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.144; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.146; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.148; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.149; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.151; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.153; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.155; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.157; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.159; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.161; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.163; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.165; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.167; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.169; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.171; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.173; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.175; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.177; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.179; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.180; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.182; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.185; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.187; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.189; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.192; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.195; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.197; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.200; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.202; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.205; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.206; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.208; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.210; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.212; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.214; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.216; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.218; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.220; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.222; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.224; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.226; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.228; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.229; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.231; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.233; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.235; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.237; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.239; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.241; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.243; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.245; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.247; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.249; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.251; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.253; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.255; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.257; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.259; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.261; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.263; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.264; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.266; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.268; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.270; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.272; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.274; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.276; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.278; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.280; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.282; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.284; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.286; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.288; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.290; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.292; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.294; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.296; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.298; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.300; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.302; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.304; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.306; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.308; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.310; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.312; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.315; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.317; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.320; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.322; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.325; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.327; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.329; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.331; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.333; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.335; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.337; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.339; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.341; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.343; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.344; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.346; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.348; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.350; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.352; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.354; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.356; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.358; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.360; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.362; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.364; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.366; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.368; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.371; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.373; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.376; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.378; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.381; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.383; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.385; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.387; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-13 00:12:36.38

[...truncated too long message...]

solr.core.SolrCore; [collection1] webapp=/solr path=/select params={q=id:555&wt=javabin&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.273; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=enablereplication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.275; org.apache.solr.core.SolrCore; [collection1] webapp=/solr path=/replication params={command=fetchindex} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.275; org.apache.solr.SolrTestCaseJ4; ###Ending doTestReplicateAfterWrite2Slave
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.286; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=302722
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.286; org.apache.http.impl.client.DefaultRequestDirector; I/O exception (org.apache.http.NoHttpResponseException) caught when processing request: The target server failed to respond
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.287; org.apache.http.impl.client.DefaultRequestDirector; Retrying request
[junit4:junit4]   1> ERROR - 2013-04-13 00:13:08.287; org.apache.solr.handler.SnapPuller; Master at: http://127.0.0.1:34655/solr is not available. Index fetch failed. Exception: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:34655/solr
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.288; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@bd1b5f
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.289; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=492,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.289; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.290; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.290; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.291; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.291; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.292; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986715/master/collection1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986715/master/collection1/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.292; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986715/master/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.293; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986715/master/collection1/data [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986715/master/collection1/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.293; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986715/master/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.294; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.366; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=18403511
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.368; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@100005b
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.369; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.369; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.369; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.370; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.371; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.421; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.422; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986883/slave/collection1/data [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986883/slave/collection1/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.423; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986883/slave/collection1/data
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.423; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986883/slave/collection1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986883/slave/collection1/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.424; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1365811986883/slave/collection1/data/index
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.424; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   1> INFO  - 2013-04-13 00:13:08.480; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=sr, timezone=America/Dawson
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.7.0_17 (32-bit)/cpus=8,threads=1,free=300610672,total=536870912
[junit4:junit4]   2> NOTE: All tests run in this JVM: [DistributedSpellCheckComponentTest, TestLMDirichletSimilarityFactory, TestConfig, TestBadConfig, CircularListTest, ExternalFileFieldSortTest, TestCloudManagedSchema, StatelessScriptUpdateProcessorFactoryTest, TestStressRecovery, TestDocumentBuilder, TestManagedSchema, DocumentBuilderTest, TestSchemaSimilarityResource, UnloadDistributedZkTest, TestSolrQueryParser, DirectSolrConnectionTest, TestSolrIndexConfig, TestFieldCollectionResource, CacheHeaderTest, TestCharFilters, SpellingQueryConverterTest, JsonLoaderTest, DocValuesTest, TestFuzzyAnalyzedSuggestions, LukeRequestHandlerTest, TestSolrDeletionPolicy2, TermVectorComponentTest, MBeansHandlerTest, TestSolrDeletionPolicy1, TestUniqueKeyFieldResource, TestIBSimilarityFactory, TestPseudoReturnFields, TestSearchPerf, ChaosMonkeyShardSplitTest, SuggesterTest, TestFieldResource, DirectUpdateHandlerOptimizeTest, SOLR749Test, ReturnFieldsTest, ZkCLITest, TestSort, TestGroupingSearch, SimpleFacetsTest, PreAnalyzedUpdateProcessorTest, AliasIntegrationTest, TestQueryUtils, TestFunctionQuery, LoggingHandlerTest, ScriptEngineTest, SuggesterFSTTest, ChaosMonkeyNothingIsSafeTest, AutoCommitTest, TermsComponentTest, FastVectorHighlighterTest, TestJoin, MoreLikeThisHandlerTest, TestLFUCache, PrimitiveFieldTypeTest, PrimUtilsTest, DateFieldTest, ResponseLogComponentTest, PeerSyncTest, TestPhraseSuggestions, TestTrie, SliceStateTest, TestRemoteStreaming, LegacyHTMLStripCharFilterTest, TestSolrCoreProperties, SystemInfoHandlerTest, TestSchemaResource, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, RecoveryZkTest, TestReplicationHandler]
[junit4:junit4] Completed on J0 in 36.11s, 12 tests, 1 failure <<< FAILURES!

[...truncated 410 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 1 failure, 13 ignored (7 assumptions)

Total time: 36 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_17 -client -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_17) - Build # 5134 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5134/
Java: 32bit/jdk1.7.0_17 -server -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 30138 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:314: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* solr/example/solr/collection1/conf/velocity/did_you_mean.vm

Total time: 39 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_17 -server -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b84) - Build # 5133 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5133/
Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:56046/z/onenodecollectioncore returned non ok status:404, message:Can not find: /z/onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:56046/z/onenodecollectioncore returned non ok status:404, message:Can not find: /z/onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([4F2A0F0666641D63:CECC811E113B7D5F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8976 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:56.839; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /z/
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:56.844; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:56.845; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:56.845; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:56.945; org.apache.solr.cloud.ZkTestServer; start zk server on port:59554
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:56.947; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.006; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@47838791 name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.006; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.007; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.012; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.013; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6be8daa name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.014; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.014; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.017; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.020; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.022; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.025; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.026; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.030; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.030; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.034; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.034; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.037; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.038; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.040; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.040; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.043; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.043; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.046; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.046; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.049; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.049; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.052; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.052; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.119; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.123; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:57606
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.124; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.124; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.125; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.125; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.125; org.apache.solr.core.CoreContainer; New CoreContainer 263501196
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.126; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.126; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.148; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.148; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.149; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.149; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.149; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.149; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.150; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.150; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.150; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.151; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.157; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.165; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:59554/solr
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.166; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.167; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.168; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6d802eb1 name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.169; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.171; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.174; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.183; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@274c6fa6 name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.183; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.186; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.190; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.193; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.196; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57606_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.197; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:57606_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.200; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.207; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.210; org.apache.solr.cloud.Overseer; Overseer (id=89509165586644995-127.0.0.1:57606_z-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.214; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.218; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.218; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.221; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.224; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.227; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.230; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.230; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.231; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.231; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.232; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.233; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.233; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.255; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.281; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.283; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.287; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.571; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.580; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.583; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.605; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.609; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.614; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:17:57.616; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:17:57.616; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.616; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:17:57.618; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:17:57.618; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.618; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.619; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365801477057/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.619; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e87bd76
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.620; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.621; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.621; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-12 21:17:57.622; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.622; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.624; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@653a211d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7845e9c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.624; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.627; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.627; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.628; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.628; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.629; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.629; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.629; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.630; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.630; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.634; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.637; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1f2c419d main
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.638; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.639; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.639; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.644; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1f2c419d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.645; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:57.645; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:58.731; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:58.732; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:57606/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:57606_z",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:58.732; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:58.734; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:58.740; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.648; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.648; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:57606/z collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.649; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.660; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.663; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.664; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.664; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:57606/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.664; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.664; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:57606/z/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.664; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:57606/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:17:59.665; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.245; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.254; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.274; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:57606/z/collection1/ and leader is http://127.0.0.1:57606/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.275; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57606/z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.275; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.275; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.275; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.277; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.279; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.279; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.292; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.302; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.304; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.306; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@38d5ab83 name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.306; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.308; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.313; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.373; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.375; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:54561
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.376; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.376; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.376; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.376; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.377; org.apache.solr.core.CoreContainer; New CoreContainer 1002281348
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.377; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.377; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.395; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.396; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.396; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.396; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.396; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.397; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.397; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.397; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.397; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.398; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.404; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.413; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:59554/solr
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.413; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.414; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.416; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3e7ae3dc name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.416; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.418; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.422; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.424; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4a1659d name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.424; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:00.430; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.435; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54561_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.436; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54561_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.439; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.439; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.440; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.440; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.446; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.447; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.447; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.447; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.449; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.449; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.449; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.471; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.496; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.498; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.502; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.766; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.767; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:57606/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:57606_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.772; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.772; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.772; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.786; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.791; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.792; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.813; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.818; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.822; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:01.824; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:01.824; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.824; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:01.825; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:01.826; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.826; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.826; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.826; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e87bd76
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.827; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.827; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.827; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:01.828; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.828; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.829; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@88a6d1f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f16c32f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.829; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.831; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.831; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.832; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.832; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.833; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.833; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.833; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.834; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.834; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.836; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.838; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@77cea872 main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.839; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.839; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.840; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.843; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@77cea872 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.845; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:01.845; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.278; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.279; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.279; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.279; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.286; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.286; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.286; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.847; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.847; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54561/z collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.848; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.859; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.862; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.862; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.863; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:54561/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.863; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.863; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:54561/z/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.864; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54561/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:03.864; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.792; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.807; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.807; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.807; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.824; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54561/z/collection1/ and leader is http://127.0.0.1:54561/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.824; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54561/z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.824; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.824; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.824; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.826; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.828; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.828; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.829; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.894; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.896; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:56046
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.897; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.897; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.897; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.898; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.898; org.apache.solr.core.CoreContainer; New CoreContainer 1382554462
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.898; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.899; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.917; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.917; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.918; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.918; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.918; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.918; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.919; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.919; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.919; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.920; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.926; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.934; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:59554/solr
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.935; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.935; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.937; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@70551bfb name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.938; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.940; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.943; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.945; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@17b1bb90 name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.945; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:04.948; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.952; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56046_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.953; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:56046_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.957; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.957; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.957; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.958; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.959; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.963; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.963; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.964; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.964; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.966; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.966; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.966; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:05.987; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.012; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.014; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.019; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.289; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.295; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.296; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.311; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.315; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.315; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.316; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.319; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.321; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.321; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.321; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:06.322; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.321; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:06.322; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.323; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:06.325; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:06.325; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.325; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.326; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365801484833/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.326; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e87bd76
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.326; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.327; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.327; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:06.327; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.327; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.328; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6bfcd2b4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@34509b03),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.329; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.330; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.331; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.331; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.332; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.332; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.332; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.332; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.333; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.333; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.335; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.337; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7d9d748d main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.338; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.338; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.338; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.342; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7d9d748d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.344; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:06.344; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.827; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.828; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56046/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:56046_z",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.829; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.829; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.836; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.836; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.836; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:07.836; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.346; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.346; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:56046/z collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.347; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.355; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.358; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.358; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.359; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:56046/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.359; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.359; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:56046/z/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.359; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:56046/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:08.359; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.342; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.352; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.352; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.352; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.352; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.368; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:56046/z/collection1/ and leader is http://127.0.0.1:56046/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.368; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56046/z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.368; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.368; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.368; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.371; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.372; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.372; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.373; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.438; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.441; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:36408
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.442; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.442; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.442; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.443; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.443; org.apache.solr.core.CoreContainer; New CoreContainer 1549209597
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.443; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.444; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.461; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.462; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.462; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.462; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.463; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.463; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.463; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.463; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.464; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.464; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.470; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.478; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:59554/solr
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.478; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.479; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.481; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6a1f75f7 name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.482; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.483; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.487; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.489; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@484518ee name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.489; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:09.493; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.497; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36408_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.499; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:36408_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.502; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.502; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.503; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.503; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.503; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.504; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.504; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.506; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.506; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.514; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.515; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.516; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.516; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.518; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.519; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.520; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.561; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.587; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.589; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.592; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.859; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.861; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56046/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:56046_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.866; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.870; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.875; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.877; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.892; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.895; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.899; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:10.901; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:10.901; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.901; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:10.903; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:10.903; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.903; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.904; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365801489378/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.904; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e87bd76
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.905; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.905; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.906; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:10.906; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.906; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.908; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29e26212 lockFactory=org.apache.lucene.store.NativeFSLockFactory@49fb63ab),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.908; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.911; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.911; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.912; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.912; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.913; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.913; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.913; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.913; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.914; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.916; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.918; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@31316f16 main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.918; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.919; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.919; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.923; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@31316f16 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.924; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:10.924; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.372; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.373; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:36408/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:36408_z",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.373; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.374; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.380; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.380; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.380; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.380; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.380; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.925; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.926; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:36408/z collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.930; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:36408/z/collection1/ and leader is http://127.0.0.1:54561/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.930; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36408/z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.930; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.930; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.933; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.934; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.934; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.934; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.934; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.935; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.936; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.937; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:12.937; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.017; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.020; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:44173
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.021; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.021; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.022; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.022; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.022; org.apache.solr.core.CoreContainer; New CoreContainer 28075483
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.023; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.023; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.040; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.042; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.042; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.042; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.043; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.043; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.049; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.057; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:59554/solr
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.057; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.058; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.060; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7411ff3c name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.061; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.063; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.067; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.068; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@634558a6 name:ZooKeeperConnection Watcher:127.0.0.1:59554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.069; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.073; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.125; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.886; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.887; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:36408/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:36408_z",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.896; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.896; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.896; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.896; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.896; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:13.896; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.076; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44173_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.079; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:44173_z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.083; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.084; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.083; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.085; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.085; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.086; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.087; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.087; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.088; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.086; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.086; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.090; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.092; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.093; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.094; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.094; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.096; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.097; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.098; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.126; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.127; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={core=collection1&action=PREPRECOVERY&onlyIfLeader=true&state=recovering&version=2&wt=javabin&coreNodeName=4&nodeName=127.0.0.1:36408_z&checkLive=true} status=0 QTime=1002 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.136; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.172; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.173; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.177; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.495; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.502; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.505; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.522; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.526; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.529; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:14.530; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:14.531; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.531; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:14.532; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:14.532; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.533; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.533; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365801492941/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.533; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e87bd76
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.534; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.534; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.534; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:14.534; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.535; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.536; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@132d7e9c lockFactory=org.apache.lucene.store.NativeFSLockFactory@217587a6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.536; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.538; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.538; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.539; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.539; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.540; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.540; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.540; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.540; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.541; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.543; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.545; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4bd642bb main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.546; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.546; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.546; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.550; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4bd642bb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.552; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:14.552; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.403; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.406; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:44173/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:44173_z",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.406; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.406; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.415; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.415; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.415; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.415; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.415; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.415; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.553; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.554; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:44173/z collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.560; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:44173/z/collection1/ and leader is http://127.0.0.1:56046/z/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.561; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44173/z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.561; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.561; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.562; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.563; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.563; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.563; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.564; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.566; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.566; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.567; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.568; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.575; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.577; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.579; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.589; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.590; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.591; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.591; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.592; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.592; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.595; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.597; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.621; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.646; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.649; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.652; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.914; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.920; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.922; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.937; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.940; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.943; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:15.944; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:15.945; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.945; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:15.946; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:15.947; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.947; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.947; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365801480313/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.948; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e87bd76
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.948; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.949; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.949; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:15.950; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.950; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.951; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@d52a3fe lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f1cd8a8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.952; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.953; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.953; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.954; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.954; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.955; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.955; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.955; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.956; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.956; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.959; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.962; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5b34f947 main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.963; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.963; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.964; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.967; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@5b34f947 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:15.969; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.147; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:54561/z/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.153; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.162; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:36408/z START replicas=[http://127.0.0.1:54561/z/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:16.165; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.165; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.165; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.165; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.165; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.165; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:54561/z/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.166; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.182; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.182; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/get params={distrib=false&version=2&wt=javabin&getVersions=100&qt=/get} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.185; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@88a6d1f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f16c32f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.186; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.186; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@88a6d1f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f16c32f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@88a6d1f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f16c32f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.187; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.187; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@6915b3c1 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.187; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.187; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/z path=/update params={openSearcher=false&softCommit=false&version=2&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.215; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.216; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.223; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.266; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.267; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/replication params={command=indexversion&version=2&wt=javabin&qt=/replication} status=0 QTime=42 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.269; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.269; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.269; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.273; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/replication params={command=filelist&generation=2&version=2&wt=javabin&qt=/replication} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.275; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.277; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index.20130412211816276
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.277; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5a401a5b lockFactory=org.apache.lucene.store.NativeFSLockFactory@481e0f99) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.286; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/replication params={checksum=true&command=filecontent&generation=2&file=segments_2&wt=filestream&qt=/replication} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.294; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.297; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.298; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.300; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29e26212 lockFactory=org.apache.lucene.store.NativeFSLockFactory@49fb63ab),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29e26212 lockFactory=org.apache.lucene.store.NativeFSLockFactory@49fb63ab),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.301; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.302; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.302; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1508d58c main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.304; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1508d58c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.305; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index.20130412211816276 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index.20130412211816276;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.305; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index.20130412211816276
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.306; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty3/index.20130412211816276
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.306; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.307; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.307; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.307; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.310; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.926; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.928; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:44173/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:44173_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.936; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "roles":"none"}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.936; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.937; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.944; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:36408/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:36408_z",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.952; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.952; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.952; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.952; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.952; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.953; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.972; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.972; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:54561/z collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.974; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.987; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.992; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.993; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.993; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:54561/z/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.993; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.994; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:54561/z/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.994; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54561/z/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:16.995; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:17.579; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:17.579; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={core=collection1&action=PREPRECOVERY&onlyIfLeader=true&state=recovering&version=2&wt=javabin&coreNodeName=5&nodeName=127.0.0.1:44173_z&checkLive=true} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.469; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.488; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.488; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.488; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.488; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.488; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.488; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.510; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54561/z/onenodecollectioncore/ and leader is http://127.0.0.1:54561/z/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.510; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:54561/z
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.510; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.511; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.513; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.514; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={action=CREATE&collection=onenodecollection&numShards=1&version=2&wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845/onenodecollection&roles=none&name=onenodecollectioncore} status=0 QTime=2925 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.515; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:18.516; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.519; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.581; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:56046/z/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.581; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:44173/z START replicas=[http://127.0.0.1:56046/z/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:19.582; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.583; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.583; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.583; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.583; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.584; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:56046/z/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.585; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.593; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/get params={distrib=false&version=2&wt=javabin&getVersions=100&qt=/get} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.595; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.599; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6bfcd2b4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@34509b03),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.600; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.601; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6bfcd2b4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@34509b03),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6bfcd2b4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@34509b03),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.601; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.602; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7e528b9f realtime
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.602; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.603; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/z path=/update params={openSearcher=false&softCommit=false&version=2&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.605; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.605; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.611; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.612; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/replication params={command=indexversion&version=2&wt=javabin&qt=/replication} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.613; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.613; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.613; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.617; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/replication params={command=filelist&generation=2&version=2&wt=javabin&qt=/replication} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.618; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.620; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index.20130412211819619
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.620; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c4ebcc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2877dcf6) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.624; org.apache.solr.core.SolrCore; [collection1] webapp=/z path=/replication params={checksum=true&command=filecontent&generation=2&file=segments_2&wt=filestream&qt=/replication} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.626; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.628; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.628; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.632; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@132d7e9c lockFactory=org.apache.lucene.store.NativeFSLockFactory@217587a6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@132d7e9c lockFactory=org.apache.lucene.store.NativeFSLockFactory@217587a6),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.633; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.634; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.634; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1952e70a main
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.636; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1952e70a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.637; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index.20130412211819619 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index.20130412211819619;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.638; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index.20130412211819619
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.639; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index.20130412211819619
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.640; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.640; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.641; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.641; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:19.644; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.003; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.005; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54561_z_onenodecollectioncore",
[junit4:junit4]   1>   "roles":"none"}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.012; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:44173/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:44173_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.021; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.022; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.021; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.021; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.021; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.021; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.522; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.525; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.526; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.553; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.556; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4683eabc name:ZooKeeperConnection Watcher:127.0.0.1:59554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.557; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:56046_z (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:36408_z (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:57606_z (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:54561_z (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:44173_z (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "3":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:56046/z",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:56046_z",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "5":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:44173/z",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:44173_z",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "2":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "4":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:36408/z",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:36408_z",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active"}}}}},
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:54561_z_onenodecollectioncore":{
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "leader":"true"}}}}},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:57606/z",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:57606_z",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"onenodecollectioncore",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54561_z"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89509165586644998-127.0.0.1:54561_z_onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:57606/z",
[junit4:junit4]   1>            "node_name":"127.0.0.1:57606_z"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89509165586644995-1-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:56046/z",
[junit4:junit4]   1>            "node_name":"127.0.0.1:56046_z"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>            "node_name":"127.0.0.1:54561_z"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89509165586645004-5-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89509165586645000-3-n_0000000000 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89509165586644998-2-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89509165586645002-4-n_0000000001 (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89509165586644995-127.0.0.1:57606_z-n_0000000000"}
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89509165586645000-127.0.0.1:56046_z-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89509165586644995-127.0.0.1:57606_z-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89509165586645004-127.0.0.1:44173_z-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89509165586644998-127.0.0.1:54561_z-n_0000000001 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89509165586645002-127.0.0.1:36408_z-n_0000000003 (0)
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.669; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 57606
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:20.683; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=263501196
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.535; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.537; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:57606/z",
[junit4:junit4]   1>   "node_name":"127.0.0.1:57606_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.545; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.545; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.545; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.545; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:21.545; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.685; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.685; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.690; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@49b66680
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.697; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.697; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.698; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.698; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.699; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.700; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.701; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.701; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.702; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.702; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.704; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89509165586644995-127.0.0.1:57606_z-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.707; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:22.708; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.708; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:22.708; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.709; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.710; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.711; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.710; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.713; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.717; org.apache.solr.cloud.Overseer; Overseer (id=89509165586644998-127.0.0.1:54561_z-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.726; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.728; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.730; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/z,null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.733; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.735; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:57606/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:57606_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.743; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.743; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.743; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.743; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.783; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 54561
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:22.784; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=1002281348
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.251; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.252; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.259; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54561/z",
[junit4:junit4]   1>   "node_name":"127.0.0.1:54561_z",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54561_z_onenodecollectioncore",
[junit4:junit4]   1>   "roles":"none"}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.268; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.268; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.268; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:24.268; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live n

[...truncated too long message...]

:28.039; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (1)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.040; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.044; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/z,null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.045; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.046; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:36408/z",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:36408_z",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "roles":null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.054; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.096; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 44173
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.097; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=28075483
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:28.219; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:28.219; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:28.220; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.099; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.099; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.104; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@258aab4f
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.114; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.115; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.115; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.116; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.119; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.119; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.120; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.120; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.121; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.121; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365801476844/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.123; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89509165586645004-127.0.0.1:44173_z-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.149; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/z,null}
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.206; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.210; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:59554 59554
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365801476845
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=4F2A0F0666641D63 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs -Dtests.timezone=Africa/Bamako -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   32.4s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:56046/z/onenodecollectioncore returned non ok status:404, message:Can not find: /z/onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([4F2A0F0666641D63:CECC811E113B7D5F]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:29.260; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 32425 T211 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:30.426; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 21:18:30.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-12 21:18:30.426; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=cs, timezone=Africa/Bamako
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=16337552,total=265748480
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestNumberUtils, TestZkChroot, FileUtilsTest, TestReload, TestFastOutputStream, TestFieldTypeResource, TestQuerySenderNoQuery, BasicZkTest, TestDefaultSimilarityFactory, DateMathParserTest, SolrRequestParserTest, TestOmitPositions, ConvertedLegacyTest, TestWordDelimiterFilterFactory, MultiTermTest, TestManagedSchema, TestJmxMonitoredMap, FieldAnalysisRequestHandlerTest, StandardRequestHandlerTest, TestRangeQuery, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.71s, 1 test, 1 error <<< FAILURES!

[...truncated 769 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 1 error, 13 ignored (7 assumptions)

Total time: 33 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b84) - Build # 5132 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5132/
Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch

Error Message:
shard2 is not consistent.  Got 44 from http://127.0.0.1:54425/collection1lastClient and got 45 from http://127.0.0.1:45200/collection1

Stack Trace:
java.lang.AssertionError: shard2 is not consistent.  Got 44 from http://127.0.0.1:54425/collection1lastClient and got 45 from http://127.0.0.1:45200/collection1
	at __randomizedtesting.SeedInfo.seed([3BB33973A36B12FA:BA55B76BD43472C6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
	at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:186)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.ShardSplitTest.testDistribSearch

Error Message:
Wrong doc count on shard1_1 expected:<50> but was:<49>

Stack Trace:
java.lang.AssertionError: Wrong doc count on shard1_1 expected:<50> but was:<49>
	at __randomizedtesting.SeedInfo.seed([3BB33973A36B12FA:BA55B76BD43472C6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:220)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8962 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.007; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.012; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.016; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.019; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.119; org.apache.solr.cloud.ZkTestServer; start zk server on port:42974
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.158; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.191; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2bb1f6 name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.191; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.192; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.215; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.216; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@d9513b name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.217; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.219; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.222; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.225; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.227; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.230; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.231; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.236; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.236; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.240; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.241; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.244; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.245; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.247; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.248; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.251; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.251; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.255; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.255; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.259; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.259; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.262; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.263; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.329; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.335; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:59526
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.336; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.336; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.337; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.337; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.337; org.apache.solr.core.CoreContainer; New CoreContainer 10296048
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.338; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.338; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.363; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.364; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.364; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.364; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.365; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.365; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.365; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.366; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.366; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.367; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.373; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.384; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42974/solr
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.390; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.391; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.393; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f490c8 name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.394; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.398; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.402; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.403; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1ff8550 name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.404; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.409; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.420; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.431; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.434; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59526_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.438; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:59526_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.448; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.466; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.470; org.apache.solr.cloud.Overseer; Overseer (id=89508853652717571-127.0.0.1:59526_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.487; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.503; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.503; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.508; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.513; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.527; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.536; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.537; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.538; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.539; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.542; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.543; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.544; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.581; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.619; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.621; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.625; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:37.993; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.000; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.002; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.024; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.032; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.039; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:38.041; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:38.041; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.042; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:38.044; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:38.045; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.045; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.059; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365796717266/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.059; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e4805
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.060; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.061; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.062; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:38.062; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.063; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.067; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b74a82; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.068; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.071; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.071; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.072; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.078; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.079; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.079; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.080; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.080; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.081; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.084; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.087; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@9b5ef5 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.088; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.088; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.093; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@9b5ef5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.094; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:38.095; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.037; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.040; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59526_",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59526",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.040; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.053; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.072; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.098; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.099; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:59526 collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.104; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.108; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.120; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.124; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.125; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.126; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:59526/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.126; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.126; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:59526/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.126; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:59526/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:39.127; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.582; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.601; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.646; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:59526/collection1/ and leader is http://127.0.0.1:59526/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.646; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59526
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.646; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.647; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.647; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.650; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.652; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.653; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.654; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.660; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.664; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.666; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@653c4 name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.666; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.669; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.676; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.739; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.741; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:54425
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.742; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.742; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.743; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.743; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.743; org.apache.solr.core.CoreContainer; New CoreContainer 26637284
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.744; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.744; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.763; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.763; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.764; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.764; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.764; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.765; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.765; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.765; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.766; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.766; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.772; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.782; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42974/solr
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.783; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.784; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.786; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1cd135f name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.786; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.789; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.792; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.793; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@14f15bf name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.793; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:40.800; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.806; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54425_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.808; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54425_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.815; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.815; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.817; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.826; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.827; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.828; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.829; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.831; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.832; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.832; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.872; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.910; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.912; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:41.916; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.110; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.110; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "core_node_name":"1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59526_",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59526",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.114; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.115; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.115; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.309; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.315; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.318; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.337; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.342; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.346; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:42.348; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:42.349; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.349; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:42.351; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:42.351; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.352; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.352; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365796720677/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.353; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e4805
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.353; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.354; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.354; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:42.355; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.355; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.359; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@152e21f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.360; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.363; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.363; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.364; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.366; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.367; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.367; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.368; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.369; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.369; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.374; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.380; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2a5371 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.381; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.382; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.386; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@2a5371 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.388; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:42.388; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.622; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.624; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54425_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54425",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.624; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.625; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.812; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.812; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:43.812; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.390; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.390; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54425 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.392; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.406; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.410; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.411; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.411; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:54425/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.412; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.412; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:54425/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.413; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54425/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:44.413; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.320; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.376; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54425/collection1/ and leader is http://127.0.0.1:54425/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.377; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54425
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.377; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.377; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.377; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.379; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.381; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.381; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.382; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.458; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.461; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46304
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.461; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.462; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.462; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.462; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.463; org.apache.solr.core.CoreContainer; New CoreContainer 502075
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.463; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.463; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.490; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.490; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.491; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.491; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.491; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.492; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.492; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.493; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.493; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.494; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.501; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.514; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42974/solr
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.514; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.515; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.516; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@16d7171 name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.517; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.519; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.523; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.524; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1bf0d80 name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.525; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:45.529; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.532; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46304_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.534; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46304_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.539; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.539; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.539; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.540; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.543; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.544; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.544; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.551; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.552; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.553; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.554; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.557; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.558; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.558; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.607; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.645; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.647; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.651; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.837; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.838; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"2",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54425_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54425",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.843; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.843; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.843; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:46.843; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.055; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.060; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.063; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.083; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.089; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.096; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:47.098; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:47.099; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.099; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:47.101; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:47.102; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.102; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.103; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365796725388/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.103; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e4805
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.104; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.105; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.105; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:47.106; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.107; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.112; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10034a4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.112; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.115; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.116; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.117; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.118; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.119; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.119; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.120; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.121; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.122; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.124; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.127; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@137f674 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.128; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.128; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.135; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@137f674 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.138; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:47.139; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.351; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.353; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:46304_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46304",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.354; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.354; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.363; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.363; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:48.363; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.141; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.142; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:46304 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.144; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.158; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.162; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.163; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.163; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:46304/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.164; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.164; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:46304/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.164; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:46304/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.165; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.873; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.888; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.888; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.888; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.888; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.926; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:46304/collection1/ and leader is http://127.0.0.1:46304/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.926; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46304
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.926; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.926; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.927; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.929; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.931; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.931; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:49.932; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.006; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.009; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:45200
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.010; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.010; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.010; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.011; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.011; org.apache.solr.core.CoreContainer; New CoreContainer 16651382
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.012; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.012; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.035; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.035; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.036; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.036; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.036; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.037; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.037; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.037; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.038; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.038; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.044; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.056; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42974/solr
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.057; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.058; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.059; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@a36a13 name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.060; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.063; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.066; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.068; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@13d5a5 name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.068; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:50.075; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.080; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45200_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.083; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:45200_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.088; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.089; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.090; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.089; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.091; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.091; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.090; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.090; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.101; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.102; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.103; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.104; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.106; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.107; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.108; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.147; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.181; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.183; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.187; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.399; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.400; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"3",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:46304_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46304",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.404; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.404; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.404; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.404; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.404; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.584; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.598; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.600; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.620; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.626; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.632; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:51.634; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:51.635; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.636; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:51.638; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:51.638; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.639; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.639; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365796729936/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.640; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e4805
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.641; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.641; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.642; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:51.642; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.643; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.648; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@117f114; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.649; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.652; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.653; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.654; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.655; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.656; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.656; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.657; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.658; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.658; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.663; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.666; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@b61358 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.666; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.667; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.673; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@b61358 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.676; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:51.677; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.910; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.911; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45200_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45200",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.912; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.912; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.921; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.921; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.921; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.921; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:52.921; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.679; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.680; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:45200 collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.686; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:45200/collection1/ and leader is http://127.0.0.1:54425/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.687; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45200
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.687; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.688; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.695; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.696; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.697; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.697; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.698; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.699; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.699; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.700; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.700; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.721; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.785; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.788; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:45161
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.788; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.789; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.789; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.790; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.791; org.apache.solr.core.CoreContainer; New CoreContainer 10086391
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.792; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.793; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.819; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.819; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.820; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.820; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.820; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.822; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.823; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.823; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.823; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.824; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.830; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.848; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:42974/solr
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.848; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.849; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.850; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15aadd2 name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.851; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.853; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.857; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.858; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6002ce name:ZooKeeperConnection Watcher:127.0.0.1:42974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.858; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:53.862; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.428; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.429; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45200_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45200",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"recovering"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.437; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.437; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.437; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.437; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.437; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.437; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.722; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.723; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&action=PREPRECOVERY&onlyIfLeader=true&core=collection1&coreNodeName=4&version=2&nodeName=127.0.0.1:45200_&checkLive=true&state=recovering} status=0 QTime=1005 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.866; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45161_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.869; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:45161_
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.873; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.873; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.874; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.874; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.874; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.874; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.876; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.876; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.878; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.878; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.886; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.886; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.888; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.888; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.891; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.892; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.892; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.923; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.971; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.974; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:54.977; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.350; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.356; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.358; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.378; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.382; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.387; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:55.388; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:55.389; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.390; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:55.391; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:55.392; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.392; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.393; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365796733710/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.393; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e4805
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.394; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.395; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.396; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:55.396; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.397; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.402; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d3f9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.403; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.406; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.406; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.407; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.408; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.409; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.410; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.410; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.411; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.412; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.417; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.423; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@e7f344 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.424; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.424; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.431; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@e7f344 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.434; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.435; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.945; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.947; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45161_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45161",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"down"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.947; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.948; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:55.956; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.437; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.438; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:45161 collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.443; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:45161/collection1/ and leader is http://127.0.0.1:46304/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.444; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45161
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.444; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.445; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.445; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.447; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.447; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.448; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.449; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.449; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.450; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.451; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.451; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.459; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.459; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.461; org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.462; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.464; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.725; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:54425/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.731; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.739; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:45200 START replicas=[http://127.0.0.1:54425/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 19:58:56.744; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.744; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.744; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.745; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.745; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.745; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:54425/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.745; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.752; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={wt=javabin&distrib=false&getVersions=100&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.757; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.759; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@152e21f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.760; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.765; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@152e21f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@152e21f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.765; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.766; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1747eec realtime
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.766; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.767; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&softCommit=false&waitSearcher=true&openSearcher=false&version=2&commit_end_point=true&commit=true} {commit=} 0 13
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.813; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.814; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.823; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.848; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.849; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=23 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.850; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.850; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.850; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.853; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=javabin&generation=2&qt=/replication&version=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.854; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.856; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index.20130412205856855
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.856; org.apache.solr.handler.SnapPuller; Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index.20130412205856855 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b1e0; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.865; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=filestream&generation=2&qt=/replication&checksum=true&command=filecontent&file=segments_2} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.873; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.888; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.889; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.892; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@117f114; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@117f114; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.893; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.893; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.894; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5284a4 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.896; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@5284a4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.897; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index.20130412205856855 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index.20130412205856855;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.898; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index.20130412205856855
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.898; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index.20130412205856855
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.900; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.900; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.901; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.901; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:56.904; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.465; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.467; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45161_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45161",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"recovering"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.467; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.474; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"4",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45200_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45200",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.482; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.482; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.482; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.482; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.482; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:57.482; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:58.461; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:58.462; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&action=PREPRECOVERY&onlyIfLeader=true&core=collection1&coreNodeName=5&version=2&nodeName=127.0.0.1:45161_&checkLive=true&state=recovering} status=0 QTime=2003 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:58.471; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:58:59.474; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.463; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:46304/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.464; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:45161 START replicas=[http://127.0.0.1:46304/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 19:59:00.465; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.466; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.466; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.467; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.468; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.468; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:46304/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.468; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.476; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={wt=javabin&distrib=false&getVersions=100&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.477; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.478; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.482; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10034a4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.483; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.495; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10034a4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10034a4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.496; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.497; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@257dd3 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.497; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.498; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&softCommit=false&waitSearcher=true&openSearcher=false&version=2&commit_end_point=true&commit=true} {commit=} 0 21
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.500; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.500; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.503; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.504; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.505; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.505; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.506; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.508; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=javabin&generation=2&qt=/replication&version=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.509; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.510; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index.20130412205900510
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.511; org.apache.solr.handler.SnapPuller; Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index.20130412205900510 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b0fa15; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.514; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={wt=filestream&generation=2&qt=/replication&checksum=true&command=filecontent&file=segments_2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.516; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.526; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.526; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.529; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d3f9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d3f9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.530; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.530; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.531; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1a7df91 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.533; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1a7df91 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.534; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index.20130412205900510 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index.20130412205900510;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.534; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index.20130412205900510
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.535; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index.20130412205900510
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.536; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.536; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.536; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.537; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:00.555; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:01.482; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:01.999; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.001; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "core_node_name":"5",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45161_",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45161",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "state":"active"}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.009; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.010; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.010; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.010; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.009; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.009; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.486; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.488; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.498; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.502; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b74a82; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.503; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.515; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b74a82; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b74a82; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.515; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.517; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1267836 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.518; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.519; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1267836 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.520; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&softCommit=false&waitSearcher=true&version=2&commit=true} {commit=} 0 22
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.531; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.555; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@152e21f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@152e21f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.556; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.557; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@dad1fe main
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.558; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.559; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@dad1fe main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.566; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:46304/collection1/, StdNode: http://127.0.0.1:45161/collection1/, StdNode: http://127.0.0.1:45200/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.575; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.584; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.584; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.585; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10034a4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10034a4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.587; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.588; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1c83f57 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.588; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.589; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1c83f57 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.590; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&expungeDeletes=false&softCommit=false&waitSearcher=true&version=2&commit_end_point=true&commit=true} {commit=} 0 15
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.605; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@117f114; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@117f114; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.606; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.606; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d3f9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365796717012/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d3f9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.607; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@bc6224 main
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.607; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.608; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.610; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@bc6224 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.610; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4913ab main
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.611; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&expungeDeletes=false&softCommit=false&waitSearcher=true&version=2&commit_end_point=true&commit=true} {commit=} 0 27
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.612; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.613; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4913ab main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.614; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&expungeDeletes=false&softCommit=false&waitSearcher=true&version=2&commit_end_point=true&commit=true} {commit=} 0 30
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.615; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&softCommit=false&waitSearcher=true&version=2&commit=true} {commit=} 0 84
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.617; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.621; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&distrib=false&tests=checkShardConsistency&q=*:*&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.625; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&distrib=false&tests=checkShardConsistency&q=*:*&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.628; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&distrib=false&tests=checkShardConsistency&q=*:*&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:02.631; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&distrib=false&tests=checkShardConsistency&q=*:*&version=2&rows=0} hits=0 status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.633; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.635; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@303ef3 name:ZooKeeperConnection Watcher:127.0.0.1:42974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.636; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508853652717580-127.0.0.1:45161_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508853652717571-127.0.0.1:59526_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508853652717578-127.0.0.1:45200_-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508853652717576-127.0.0.1:46304_-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508853652717574-127.0.0.1:54425_-n_0000000001 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89508853652717571-127.0.0.1:59526_-n_0000000000"}
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:45161_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:45200_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:46304_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:54425_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:59526_ (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "3":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:46304_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:46304",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "5":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:45161_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:45161",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "2":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:54425_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:54425",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "4":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:45200_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:45200",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active"}}}}},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "node_name":"127.0.0.1:59526_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:59526",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>   /solr/collections (2)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:54425_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:54425",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:46304_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:46304",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89508853652717578-4-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89508853652717574-2-n_0000000000 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89508853652717580-5-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89508853652717576-3-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "node_name":"127.0.0.1:59526_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:59526",
[junit4:junit4]   1>            "core":"collection1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89508853652717571-1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.737; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&_version_=-1432141687402004480&update.from=http://127.0.0.1:54425/collection1/} {deleteByQuery=*:* (-1432141687402004480)} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.742; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&_version_=-1432141687408295936&update.from=http://127.0.0.1:46304/collection1/} {deleteByQuery=*:* (-1432141687408295936)} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.743; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2} {deleteByQuery=*:* (-1432141687408295936)} 0 7
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.744; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1432141687402004480)} 0 16
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.749; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1432141687419830272)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.766; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[0 (1432141687433461760)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.767; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[0 (1432141687433461760)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.768; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 16
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.772; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1432141687444996096)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.778; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[1 (1432141687449190400)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.779; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1432141687449190400)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.783; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1432141687456530432)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.791; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[2 (1432141687460724736)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.792; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1432141687460724736)]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.796; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1432141687470161920)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.804; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[3 (1432141687475404800)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.805; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[3 (1432141687475404800)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.806; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.809; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1432141687484841984)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.818; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[4 (1432141687490084864)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.819; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[4 (1432141687490084864)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.820; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.823; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1432141687498473472)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.830; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[5 (1432141687502667776)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.831; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1432141687502667776)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.834; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1432141687511056384)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.842; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[6 (1432141687516299264)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.843; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[6 (1432141687516299264)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.844; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.848; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1432141687524687872)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.856; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:54425/collection1/&version=2} {add=[7 (1432141687529930752)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.857; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[7 (1432141687529930752)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.858; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.861; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1432141687538319360)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.867; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:46304/collection1/&version=2} {add=[8 (1432141687542513664)]} 0 0
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.868; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1432141687542513664)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-12 19:59:04.872; org.a

[...truncated too long message...]

ud.ShardSplitTest-1365797646392/jetty4/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.243; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1365797646392/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.244; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ShardSplitTest-1365797646392/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1365797646392/jetty4;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.245; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1365797646392/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.246; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89508914554208268-127.0.0.1:36705_-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.249; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.249; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-12 20:14:55.250; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-12 20:14:55.251; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.252; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.273; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.334; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.338; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:51512 51512
[junit4:junit4]   1> WARN  - 2013-04-12 20:14:55.436; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.436; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> WARN  - 2013-04-12 20:14:55.437; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.442; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1c1675f name:ZooKeeperConnection Watcher:127.0.0.1:51512/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.442; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.446; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 37069
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.447; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.448; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:51512 51512
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1365797646393
[junit4:junit4]   2> !!!! WARNING: best effort to remove /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-1365797646392 FAILED !!!!!
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=3BB33973A36B12FA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca_ES -Dtests.timezone=ART -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 49.1s J1 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Wrong doc count on shard1_1 expected:<50> but was:<49>
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([3BB33973A36B12FA:BA55B76BD43472C6]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:220)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-12 20:14:55.461; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 49078 T3560 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=ca_ES, timezone=ART
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=205838520,total=333918208
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrQueryParserDefaultOperatorResource, TestSuggestSpellingConverter, TestSolr4Spatial, TestNumberUtils, OpenCloseCoreStressTest, TestJmxMonitoredMap, TestLMJelinekMercerSimilarityFactory, EchoParamsTest, TestBinaryResponseWriter, DisMaxRequestHandlerTest, TestRecovery, TestPropInject, ChaosMonkeyShardSplitTest, TestFastOutputStream, SpellPossibilityIteratorTest, MultiTermTest, TestStressReorder, StandardRequestHandlerTest, StatsComponentTest, TestHashPartitioner, PathHierarchyTokenizerFactoryTest, ZkNodePropsTest, IndexBasedSpellCheckerTest, TestZkChroot, TestPartialUpdateDeduplication, OpenExchangeRatesOrgProviderTest, TermVectorComponentDistributedTest, TestDFRSimilarityFactory, DefaultValueUpdateProcessorTest, TestRTGBase, SpellCheckComponentTest, CurrencyFieldXmlFileTest, OutputWriterTest, BasicZkTest, SimplePostToolTest, TestDefaultSimilarityFactory, DistanceFunctionTest, TestLazyCores, SolrPluginUtilsTest, DocValuesMultiTest, TestDistributedGrouping, FullSolrCloudDistribCmdsTest, BadIndexSchemaTest, TestSolrJ, SuggesterTSTTest, XsltUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestAnalyzedSuggestions, TestLuceneMatchVersion, TestArbitraryIndexDir, QueryResultKeyTest, TestRandomFaceting, CopyFieldTest, TestCSVLoader, TestQuerySenderNoQuery, IndexSchemaRuntimeFieldTest, URLClassifyProcessorTest, SuggesterWFSTTest, SampleTest, SignatureUpdateProcessorFactoryTest, SolrRequestParserTest, TestCSVResponseWriter, TestCollationField, TestComponentsName, TestFoldingMultitermQuery, NotRequiredUniqueKeyTest, IndexReaderFactoryTest, TestRangeQuery, NoCacheHeaderTest, DirectSolrSpellCheckerTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, ZkSolrClientTest, ShardRoutingCustomTest, SliceStateUpdateTest, TestDistributedSearch, TestRealTimeGet, TestMultiCoreConfBootstrap, TestReload, HardAutoCommitTest, DistributedTermsComponentTest, TestGroupingSearch, TestFiltering, SpellCheckCollatorTest, SuggesterTest, SpatialFilterTest, WordBreakSolrSpellCheckerTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, TestSolrDeletionPolicy1, DebugComponentTest, TestSurroundQueryParser, TestQueryUtils, TestWriterPerf, TestQueryTypes, TestOmitPositions, XmlUpdateRequestHandlerTest, TestIndexingPerformance, RequiredFieldsTest, LoggingHandlerTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestLFUCache, SOLR749Test, UpdateParamsTest, TestSolrIndexConfig, BadComponentTest, TestMergePolicyConfig, TestBinaryField, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestCodecSupport, SynonymTokenizerTest, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TestPluginEnable, TimeZoneUtilsTest, ScriptEngineTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, TestSolrXMLSerializer, PreAnalyzedFieldTest, TestSystemIdResolver, DOMUtilTest, ClusterStateTest, TestUtils, TestDocumentBuilder, SliceStateTest, SystemInfoHandlerTest, FileUtilsTest, ShardSplitTest]
[junit4:junit4] Completed on J1 in 49.87s, 1 test, 1 failure <<< FAILURES!

[...truncated 53 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 2 failures, 13 ignored (7 assumptions)

Total time: 39 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b84) - Build # 5131 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5131/
Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:56534/v/l/onenodecollectioncore returned non ok status:404, message:Can not find: /v/l/onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:56534/v/l/onenodecollectioncore returned non ok status:404, message:Can not find: /v/l/onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([AD626F078F64236C:2C84E11FF83B4350]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9247 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:23.483; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:23.487; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:23.488; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:23.488; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:23.588; org.apache.solr.cloud.ZkTestServer; start zk server on port:44888
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:23.590; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.323; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6a5afbf8 name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.324; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.325; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.332; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.334; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@649d18c3 name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.335; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.335; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.341; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.344; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.346; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.348; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.348; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.352; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.352; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.355; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.356; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.361; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.362; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.367; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.368; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.371; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.371; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.373; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.374; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.377; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.377; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.380; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.381; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.450; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.461; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:34990
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.463; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.463; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.464; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.465; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.465; org.apache.solr.core.CoreContainer; New CoreContainer 2073689088
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.466; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.467; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.498; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.498; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.499; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.499; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.499; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.500; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.500; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.500; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.501; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.501; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.507; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.516; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:44888/solr
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.517; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.518; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.519; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@50d808d9 name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.520; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.522; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.527; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.529; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4788dbb5 name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.529; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.532; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.537; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.541; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.544; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34990_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.545; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:34990_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.550; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.559; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.564; org.apache.solr.cloud.Overseer; Overseer (id=89508526390706179-127.0.0.1:34990_v%2Fl-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.569; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.576; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.576; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.580; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.584; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.589; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.591; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.591; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.592; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.593; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.594; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.594; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.595; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.644; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.677; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.678; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:24.682; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.044; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.051; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.054; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.065; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.068; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.071; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:25.072; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:25.072; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.072; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:25.074; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:25.074; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.074; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.074; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365791724385/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.075; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@21b6ee4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.075; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.076; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.076; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:25.076; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.077; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.078; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2eb8bec2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61096f63)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.078; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.080; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.081; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.081; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.082; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.082; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.082; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.083; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.083; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.084; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.086; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.089; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@56e19995 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.089; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.090; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.090; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.094; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@56e19995 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.095; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:25.096; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:26.094; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:26.096; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:34990/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:34990_v%2Fl",
[junit4:junit4]   1>   "numShards":"1"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:26.096; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:26.097; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:26.105; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.098; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.098; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:34990/v/l collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.100; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.112; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.116; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.117; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.117; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:34990/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.117; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.118; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:34990/v/l/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.118; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:34990/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.118; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.611; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.617; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.630; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:34990/v/l/collection1/ and leader is http://127.0.0.1:34990/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.630; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34990/v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.631; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.631; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.631; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.633; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.634; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.634; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.635; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.638; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.639; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.641; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@11f4eff name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.641; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.643; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.645; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.710; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.712; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:38843
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.713; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.714; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.714; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.715; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.715; org.apache.solr.core.CoreContainer; New CoreContainer 1048824702
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.716; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.716; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.736; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.737; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.737; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.737; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.739; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.744; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.755; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:44888/solr
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.755; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.756; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.759; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2c131b7f name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.759; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.762; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.765; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.767; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@43d31da2 name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.767; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:27.772; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.775; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38843_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.784; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:38843_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.788; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.788; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.788; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.788; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.795; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.795; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.796; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.796; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.798; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.798; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.799; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.832; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.863; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.865; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:28.869; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.121; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.122; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:34990/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:34990_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:34990_v%2Fl",
[junit4:junit4]   1>   "numShards":"1"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.125; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.126; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.126; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.202; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.208; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.210; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.229; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.234; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.239; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:29.241; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:29.241; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.242; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:29.244; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:29.244; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.245; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.245; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.245; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@21b6ee4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.246; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.247; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.248; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:29.248; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.249; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.251; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69ee2169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a7f1b33)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.252; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.256; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.256; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.258; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.259; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.260; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.260; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.261; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.262; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.262; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.266; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.268; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@66b672e7 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.269; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.269; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.269; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.273; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@66b672e7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.273; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:29.274; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.631; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.632; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38843_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.633; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.633; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.639; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.639; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:30.640; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.277; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.278; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:38843/v/l collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.279; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.291; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.296; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.296; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.297; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:38843/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.297; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.298; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:38843/v/l/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.298; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:38843/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:31.298; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.146; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.158; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.158; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.158; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.161; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38843/v/l/collection1/ and leader is http://127.0.0.1:38843/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.161; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38843/v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.161; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.161; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.162; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.164; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.166; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.166; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.167; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.255; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.258; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:56534
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.259; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.260; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.260; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.261; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.262; org.apache.solr.core.CoreContainer; New CoreContainer 217726708
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.262; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.263; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.282; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.283; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.284; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.284; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.285; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.285; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.286; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.286; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.287; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.287; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.294; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.305; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:44888/solr
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.305; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.306; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.308; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@61d5f5c8 name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.309; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.311; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.315; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.317; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@28638cf0 name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.317; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:32.323; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.328; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56534_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.330; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:56534_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.335; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.336; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.336; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.336; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.335; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.337; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.337; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.344; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.345; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.346; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.346; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.349; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.350; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.350; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.390; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.417; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.420; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.423; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.664; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.665; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:38843_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38843_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.741; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.747; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.749; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.768; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.773; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.777; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:33.779; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:33.780; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.780; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:33.782; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:33.782; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.782; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.783; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365791732173/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.783; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@21b6ee4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.784; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.785; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.785; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:33.786; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.786; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.789; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d98c094 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25b3dd4)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.789; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.793; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.793; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.794; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.795; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.796; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.796; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.797; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.798; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.799; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.803; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.808; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@430dd989 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.809; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.809; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.809; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.814; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@430dd989 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.816; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:33.816; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.174; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.176; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56534/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:56534_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.177; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.177; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.184; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.184; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.184; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.184; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.820; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.820; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:56534/v/l collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.822; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.833; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.837; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.837; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.838; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:56534/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.838; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.839; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:56534/v/l/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.839; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:56534/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:35.839; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.690; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.698; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.698; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.698; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.698; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.750; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:56534/v/l/collection1/ and leader is http://127.0.0.1:56534/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.750; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56534/v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.750; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.751; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.751; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.755; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.756; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.757; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.758; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.832; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.834; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:51084
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.836; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.836; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.836; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.837; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.837; org.apache.solr.core.CoreContainer; New CoreContainer 750037124
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.837; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.838; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.858; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.858; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.858; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.859; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.859; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.859; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.860; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.860; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.860; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.861; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.866; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.876; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:44888/solr
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.877; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.878; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.879; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@64250c70 name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.880; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.883; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.886; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.888; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5750ead3 name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.888; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:36.894; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.899; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51084_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.902; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:51084_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.905; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.905; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.905; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.906; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.906; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.906; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.907; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.908; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.908; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.913; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.913; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.914; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.914; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.916; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.917; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.918; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.944; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.974; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.976; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:37.980; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.205; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.206; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:56534/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:56534_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:56534_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.211; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.211; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.211; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.211; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.211; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.319; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.324; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.327; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.340; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.343; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.347; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:38.348; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:38.349; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.349; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:38.350; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:38.351; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.351; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.351; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365791736763/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.351; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@21b6ee4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.352; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.352; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.353; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:38.353; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.353; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.355; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@13bc8abe lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b5c0664)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.356; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.358; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.358; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.359; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.359; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.360; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.360; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.361; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.361; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.362; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.365; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.368; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@433d9d21 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.369; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.369; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.370; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.373; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@433d9d21 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.375; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:38.375; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.718; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.719; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51084/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51084_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.720; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.720; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.727; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.727; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.727; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.727; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:39.727; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.377; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.378; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:51084/v/l collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.384; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:51084/v/l/collection1/ and leader is http://127.0.0.1:38843/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.384; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51084/v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.385; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.385; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.386; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.387; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.388; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.388; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.388; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.390; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.390; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.390; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.391; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.398; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:51084_v%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.469; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.472; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:41579
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.473; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.474; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.474; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.475; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.476; org.apache.solr.core.CoreContainer; New CoreContainer 1637415874
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.477; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.477; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.498; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.498; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.499; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.499; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.499; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.500; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.500; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.500; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.501; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.501; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.506; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.514; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:44888/solr
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.515; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.516; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.519; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@602e508b name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.520; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.523; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.527; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.528; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@55dcc8b1 name:ZooKeeperConnection Watcher:127.0.0.1:44888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.529; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:40.536; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.234; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.235; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51084/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:51084_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51084_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.241; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.241; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.241; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.241; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.241; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.241; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.399; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:51084_v%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.400; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={onlyIfLeader=true&wt=javabin&action=PREPRECOVERY&nodeName=127.0.0.1:51084_v%252Fl&version=2&checkLive=true&state=recovering&coreNodeName=127.0.0.1:51084_v%252Fl_collection1&core=collection1} status=0 QTime=1002 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.541; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41579_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.543; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:41579_v%2Fl
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.547; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.547; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.548; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.548; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.548; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.548; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.550; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.549; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.551; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.550; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.551; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.562; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.562; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.563; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.563; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.565; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.565; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.566; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.588; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.629; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.632; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.636; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.923; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.928; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.930; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.948; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.952; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.957; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:41.959; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:41.960; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.960; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:41.962; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:41.962; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.963; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.963; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365791740397/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.964; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@21b6ee4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.964; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.965; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.966; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:41.966; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.967; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.969; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2b29ca4b lockFactory=org.apache.lucene.store.NativeFSLockFactory@604fc467)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.970; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.973; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.973; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.975; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.976; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.977; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.977; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.978; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.978; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.979; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.983; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.985; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5a0ac063 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.986; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.986; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.986; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.992; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@5a0ac063 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.995; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:41.995; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.751; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.769; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41579/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:41579_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.770; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.770; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.998; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:42.999; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:41579/v/l collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.005; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:41579/v/l/collection1/ and leader is http://127.0.0.1:56534/v/l/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.005; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41579/v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.005; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.006; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.006; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.008; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.008; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.008; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.009; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.010; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.011; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.011; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.012; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.018; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.019; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:41579_v%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.020; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.026; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.027; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.028; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.029; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.031; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.031; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.035; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.037; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.074; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.101; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.103; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.107; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.401; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:38843/v/l/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.401; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:51084/v/l START replicas=[http://127.0.0.1:38843/v/l/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:43.402; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.403; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.403; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.403; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.403; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.403; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:38843/v/l/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.403; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.406; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/get params={wt=javabin&version=2&qt=/get&getVersions=100&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.406; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.408; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69ee2169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a7f1b33)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.409; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.410; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69ee2169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a7f1b33)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69ee2169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a7f1b33)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.411; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.411; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@8a43edb realtime
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.412; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.412; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/v/l path=/update params={commit_end_point=true&wt=javabin&version=2&commit=true&waitSearcher=true&openSearcher=false&softCommit=false} {commit=} 0 6
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.412; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.414; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.414; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.418; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.418; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/replication params={wt=javabin&version=2&qt=/replication&command=indexversion} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.419; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.419; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.419; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.419; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.421; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/replication params={wt=javabin&version=2&qt=/replication&command=filelist&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.421; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.422; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.423; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index.20130412213543422
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.424; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69ba559f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1efc9413)) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.426; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/replication params={wt=filestream&checksum=true&qt=/replication&command=filecontent&file=segments_2&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.428; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.429; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.429; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.431; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@13bc8abe lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b5c0664)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@13bc8abe lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b5c0664)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.432; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.432; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.433; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5d43c536 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.434; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@5d43c536 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.434; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index.20130412213543422 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index.20130412213543422;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.434; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index.20130412213543422
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.435; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty3/index.20130412213543422
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.435; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.435; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.436; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.436; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.438; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.441; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.448; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.454; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:43.456; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:43.457; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.457; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:43.460; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:43.460; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.461; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.461; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365791727646/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.462; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@21b6ee4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.463; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.464; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.465; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:43.465; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.466; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.469; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@73ed1b6a lockFactory=org.apache.lucene.store.NativeFSLockFactory@5efaa0da)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.470; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.473; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.474; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.475; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.476; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.477; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.477; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.478; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.479; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.480; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.484; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.486; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1621a367 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.486; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.486; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.487; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.490; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@1621a367 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:43.490; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.283; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.285; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41579/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41579_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:41579_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.292; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51084/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:51084_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51084_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.298; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38843_v%2Fl",
[junit4:junit4]   1>   "numShards":"1"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.299; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.299; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.305; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.305; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.306; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.306; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.305; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.305; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.492; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.493; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:38843/v/l collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.494; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.508; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.513; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.514; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.514; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:38843/v/l/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.515; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.515; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:38843/v/l/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.516; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:38843/v/l/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:44.516; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.020; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:41579_v%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.021; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={onlyIfLeader=true&wt=javabin&action=PREPRECOVERY&nodeName=127.0.0.1:41579_v%252Fl&version=2&checkLive=true&state=recovering&coreNodeName=127.0.0.1:41579_v%252Fl_collection1&core=collection1} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.818; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.829; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.829; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.829; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.829; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.829; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.829; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.882; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38843/v/l/onenodecollectioncore/ and leader is http://127.0.0.1:38843/v/l/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.883; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:38843/v/l
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.884; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.884; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.888; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.890; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={roles=none&wt=javabin&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&version=2&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487/onenodecollection&numShards=1} status=0 QTime=2864 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.891; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:45.893; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:46.896; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.022; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:56534/v/l/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.023; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:41579/v/l START replicas=[http://127.0.0.1:56534/v/l/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:47.023; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.024; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.024; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.024; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.024; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.025; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:56534/v/l/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.025; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.030; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/get params={wt=javabin&version=2&qt=/get&getVersions=100&distrib=false} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.032; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.035; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d98c094 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25b3dd4)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.036; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.038; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d98c094 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25b3dd4)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d98c094 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25b3dd4)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.038; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.039; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1ae3f0df realtime
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.040; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.040; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/v/l path=/update params={commit_end_point=true&wt=javabin&version=2&commit=true&waitSearcher=true&openSearcher=false&softCommit=false} {commit=} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.042; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.042; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.044; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.045; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/replication params={wt=javabin&version=2&qt=/replication&command=indexversion} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.046; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.046; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.046; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.049; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/replication params={wt=javabin&version=2&qt=/replication&command=filelist&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.050; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.052; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index.20130412213547051
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.052; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2413a994 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9c646cd)) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.055; org.apache.solr.core.SolrCore; [collection1] webapp=/v/l path=/replication params={wt=filestream&checksum=true&qt=/replication&command=filecontent&file=segments_2&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.058; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.059; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.059; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.061; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2b29ca4b lockFactory=org.apache.lucene.store.NativeFSLockFactory@604fc467)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2b29ca4b lockFactory=org.apache.lucene.store.NativeFSLockFactory@604fc467)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.061; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.062; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.062; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@419da1d3 main
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.064; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@419da1d3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.065; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index.20130412213547051 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index.20130412213547051;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.065; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index.20130412213547051
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.066; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index.20130412213547051
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.066; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.066; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.067; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.067; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.069; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.338; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.340; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:38843_v%2Fl_onenodecollectioncore",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38843_v%2Fl",
[junit4:junit4]   1>   "numShards":"1"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.346; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:41579/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:41579_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:41579_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.354; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.354; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.354; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.354; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.354; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.354; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.899; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.901; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.901; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.911; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.914; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5b2ad200 name:ZooKeeperConnection Watcher:127.0.0.1:44888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.914; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:38843_v%2Fl_onenodecollectioncore":{
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38843_v%2Fl",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:38843_v%2Fl_collection1":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38843_v%2Fl",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:51084_v%2Fl_collection1":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:51084/v/l",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:51084_v%2Fl"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:56534_v%2Fl_collection1":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:56534/v/l",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:56534_v%2Fl",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:41579_v%2Fl_collection1":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:41579/v/l",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:41579_v%2Fl"}}}},
[junit4:junit4]   1>           "router":"compositeId"},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:34990_v%2Fl_collection1":{
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:34990/v/l",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:34990_v%2Fl",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:56534_v%2Fl (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:41579_v%2Fl (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:34990_v%2Fl (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:51084_v%2Fl (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:38843_v%2Fl (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508526390706188-127.0.0.1:41579_v%2Fl-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508526390706186-127.0.0.1:51084_v%2Fl-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508526390706184-127.0.0.1:56534_v%2Fl-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508526390706182-127.0.0.1:38843_v%2Fl-n_0000000001 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508526390706179-127.0.0.1:34990_v%2Fl-n_0000000000 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89508526390706179-127.0.0.1:34990_v%2Fl-n_0000000000"}
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "router":"compositeId",
[junit4:junit4]   1>          "configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>            "core":"onenodecollectioncore",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38843_v%2Fl"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89508526390706182-127.0.0.1:38843_v%2Fl_onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38843_v%2Fl"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:56534/v/l",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:56534_v%2Fl"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89508526390706182-127.0.0.1:38843_v%2Fl_collection1-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89508526390706186-127.0.0.1:51084_v%2Fl_collection1-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89508526390706184-127.0.0.1:56534_v%2Fl_collection1-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89508526390706188-127.0.0.1:41579_v%2Fl_collection1-n_0000000001 (0)
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:34990/v/l",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:34990_v%2Fl"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89508526390706179-127.0.0.1:34990_v%2Fl_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.967; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 34990
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:47.968; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=2073689088
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.865; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.867; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:34990/v/l",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:34990_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:34990_v%2Fl"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:48.875; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.969; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.970; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.974; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@14ca473f
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.980; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.980; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.981; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.981; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.982; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.983; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.984; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.984; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.985; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.986; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.987; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89508526390706179-127.0.0.1:34990_v%2Fl-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.990; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.990; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.990; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.990; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.994; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.994; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.994; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.994; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.995; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:49.999; org.apache.solr.cloud.Overseer; Overseer (id=89508526390706182-127.0.0.1:38843_v%2Fl-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.008; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.010; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.014; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/v/l,null}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.015; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.016; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:34990/v/l",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:34990_v%2Fl_collection1",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:34990_v%2Fl",
[junit4:junit4]   1>   "numShards":"2"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.022; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.022; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.022; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.022; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.067; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 38843
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:50.068; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=1048824702
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:51.290; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:51.291; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:51.291; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:51.529; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:51.531; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:38843_v%2Fl_onenodecollectioncore",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "node_name":"127.0.0.1:38843_v%2Fl"}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:51.537; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:38843/v/l",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>  

[...truncated too long message...]

d type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:55.503; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.371; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.372; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.377; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7d0acc8d
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.386; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.387; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.388; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.388; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.390; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.391; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.392; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.392; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.393; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.393; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365791723487/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.395; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89508526390706188-127.0.0.1:41579_v%2Fl-n_0000000004) am no longer a leader.
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:56.398; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.398; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:56.398; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.420; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/v/l,null}
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.478; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.481; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:44888 44888
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365791723487
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=AD626F078F64236C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_SV -Dtests.timezone=Asia/Nicosia -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   33.0s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:56534/v/l/onenodecollectioncore returned non ok status:404, message:Can not find: /v/l/onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([AD626F078F64236C:2C84E11FF83B4350]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.498; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 33022 T1714 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:56.596; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 18:35:56.596; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> WARN  - 2013-04-12 18:35:56.596; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=127), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=127)), sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=es_SV, timezone=Asia/Nicosia
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=251059352,total=525336576
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestCoreDiscovery, BadIndexSchemaTest, ConvertedLegacyTest, QueryResultKeyTest, TestJmxIntegration, SuggesterTSTTest, SpellPossibilityIteratorTest, SortByFunctionTest, DOMUtilTest, CoreContainerCoreInitFailuresTest, OpenExchangeRatesOrgProviderTest, MultiTermTest, RequestHandlersTest, NoCacheHeaderTest, DocumentAnalysisRequestHandlerTest, TestCSVResponseWriter, FieldAnalysisRequestHandlerTest, FullSolrCloudDistribCmdsTest, TestMergePolicyConfig, TestAtomicUpdateErrorCases, LeaderElectionIntegrationTest, CurrencyFieldXmlFileTest, DistanceFunctionTest, TestRangeQuery, TestArbitraryIndexDir, TestFastOutputStream, TestHashPartitioner, SolrRequestParserTest, StandardRequestHandlerTest, TestIndexingPerformance, PingRequestHandlerTest, TestZkChroot, DocValuesMultiTest, HighlighterTest, CopyFieldTest, SolrPluginUtilsTest, TestSuggestSpellingConverter, TestSolrJ, TestNumberUtils, DateMathParserTest, SampleTest, TestStressLucene, SolrCoreCheckLockOnStartupTest, TestSchemaSimilarityResource, SpellCheckCollatorTest, TestUniqueKeyFieldResource, DefaultValueUpdateProcessorTest, TestBinaryField, TestDistributedSearch, SimplePostToolTest, TestCodecSupport, TestStressReorder, TestLMJelinekMercerSimilarityFactory, TestFieldTypeResource, NotRequiredUniqueKeyTest, TestDefaultSimilarityFactory, XsltUpdateRequestHandlerTest, CurrencyFieldOpenExchangeTest, RequiredFieldsTest, DisMaxRequestHandlerTest, CollectionsAPIDistributedZkTest, FileUtilsTest, TestCSVLoader, TimeZoneUtilsTest, TestOmitPositions, TestSolr4Spatial, TestAnalyzedSuggestions, SolrCmdDistributorTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.55s, 1 test, 1 error <<< FAILURES!

[...truncated 499 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 1 error, 13 ignored (7 assumptions)

Total time: 37 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b84) - Build # 5130 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5130/
Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:35652/jd_p/onenodecollectioncore returned non ok status:404, message:Can not find: /jd_p/onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:35652/jd_p/onenodecollectioncore returned non ok status:404, message:Can not find: /jd_p/onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([101847F3B6A0DBFD:91FEC9EBC1FFBBC1]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9272 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.163; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /jd_p/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.167; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.167; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.168; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.268; org.apache.solr.cloud.ZkTestServer; start zk server on port:54916
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.269; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.403; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@55073511 name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.403; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.404; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.409; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.410; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5bc0d1c1 name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.410; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.411; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.414; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.416; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.417; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.419; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.419; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.423; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.423; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.426; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.427; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.429; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.429; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.431; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.432; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.435; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.435; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.438; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.438; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.441; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.441; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.444; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.444; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.524; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.555; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:45741
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.556; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.556; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.557; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.558; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.558; org.apache.solr.core.CoreContainer; New CoreContainer 2050774884
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.559; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.560; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.592; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.592; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.593; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.593; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.593; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.594; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.594; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.594; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.594; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.595; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.615; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.626; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:54916/solr
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.626; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.627; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.629; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@77124fd4 name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.630; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.632; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.637; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.639; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6ddedca8 name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.639; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.642; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.647; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.652; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.655; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45741_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.657; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:45741_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.662; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.705; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.709; org.apache.solr.cloud.Overseer; Overseer (id=89508168346435587-127.0.0.1:45741_jd_p-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.715; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.722; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.724; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.728; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.731; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.737; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.741; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.742; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.743; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.743; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.746; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.746; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.747; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.777; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.804; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.806; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:20.810; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.109; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.115; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.117; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.131; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.134; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.137; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:21.138; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:21.138; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.138; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:21.139; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:21.140; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.140; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.140; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1365786260447/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.140; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51418713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.141; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.141; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.141; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:21.141; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.142; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.143; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@22e4655a lockFactory=org.apache.lucene.store.NativeFSLockFactory@76c2315a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.143; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.145; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.145; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.146; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.146; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.146; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.146; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.147; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.147; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.147; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.150; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.152; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@86c801a main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.152; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.152; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.153; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.156; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@86c801a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.157; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:21.157; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:22.242; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:22.243; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45741/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:45741_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:22.243; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:22.243; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:22.247; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.159; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.159; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:45741/jd_p collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.160; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.166; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.168; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.169; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.169; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:45741/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.169; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.169; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:45741/jd_p/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.170; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:45741/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.170; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.750; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.758; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.776; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:45741/jd_p/collection1/ and leader is http://127.0.0.1:45741/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.776; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45741/jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.777; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.777; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.777; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.778; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.780; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.780; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.780; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.783; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.784; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.785; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@794d0748 name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.785; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.787; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.789; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.847; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.849; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:49204
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.850; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.850; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.850; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.851; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.851; org.apache.solr.core.CoreContainer; New CoreContainer 453853168
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.851; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.852; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.870; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.871; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.871; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.871; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.872; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.872; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.872; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.873; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.873; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.873; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.878; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.888; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:54916/solr
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.888; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.889; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.890; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@9d9fbb7 name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.891; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.892; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.895; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.896; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2a1ba2 name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.896; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:23.900; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.902; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49204_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.904; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:49204_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.907; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.907; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.907; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.908; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.912; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.912; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.913; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.913; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.914; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.915; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.915; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.938; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.966; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.968; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:24.972; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.262; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.263; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:45741_jd_p_collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45741/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:45741_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.266; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.266; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.266; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.279; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.285; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.287; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.301; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.304; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.306; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:25.308; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:25.308; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.308; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:25.310; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:25.310; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.310; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.310; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.310; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51418713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.311; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.311; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.311; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:25.312; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.312; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.313; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@698d5c80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a357166),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.313; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.315; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.315; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.316; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.316; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.316; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.317; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.317; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.317; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.318; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.320; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.322; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1d92acf7 main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.322; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty1/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.322; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.323; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.326; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1d92acf7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.327; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:25.327; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:26.770; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:26.771; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:26.771; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:26.771; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:27.766; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:27.766; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:27.766; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.329; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.329; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:49204/jd_p collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.330; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.337; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.339; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.339; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.339; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:49204/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.339; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.340; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:49204/jd_p/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.340; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:49204/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:28.340; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.270; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.278; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.278; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.278; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.297; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:49204/jd_p/collection1/ and leader is http://127.0.0.1:49204/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.297; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49204/jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.297; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.297; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.298; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.299; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.300; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.301; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.301; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.364; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.366; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:35652
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.367; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.367; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.367; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.368; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.368; org.apache.solr.core.CoreContainer; New CoreContainer 178585713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.369; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.369; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.389; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.389; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.390; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.390; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.390; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.391; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.391; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.391; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.392; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.392; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.398; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.407; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:54916/solr
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.408; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.409; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.410; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@35d98656 name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.411; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.414; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.417; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.418; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6333869d name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.418; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:29.427; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.431; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35652_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.432; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:35652_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.435; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.435; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.436; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.436; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.436; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.437; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.437; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.440; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.441; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.441; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.441; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.442; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.443; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.443; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.467; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.496; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.497; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.502; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.783; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.784; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:49204_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.813; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.825; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.831; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.833; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.845; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.848; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.851; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:30.852; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:30.852; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.852; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:30.853; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:30.853; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.854; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.854; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1365786269304/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.854; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51418713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.854; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.855; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.855; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:30.855; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.855; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.857; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ce1e8bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc61c2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.857; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.859; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.859; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.859; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.860; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.860; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.860; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.861; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.861; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.861; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.864; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.866; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5c27a54f main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.866; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty2/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.867; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.867; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.870; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@5c27a54f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.871; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:30.871; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.318; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.319; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:35652/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:35652_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.319; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.319; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.325; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.325; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.325; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.325; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.873; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.873; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:35652/jd_p collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.874; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.879; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.881; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.882; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.882; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:35652/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.882; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.882; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:35652/jd_p/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.882; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:35652/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:32.883; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.829; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.837; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.837; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.837; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.837; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.889; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:35652/jd_p/collection1/ and leader is http://127.0.0.1:35652/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.890; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35652/jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.890; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.890; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.890; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.893; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.894; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.895; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.895; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.958; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.960; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:60612
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.961; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.961; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.961; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.962; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.962; org.apache.solr.core.CoreContainer; New CoreContainer 1737254206
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.962; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.963; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.982; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.983; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.983; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.984; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.984; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.984; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.985; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.985; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.985; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.986; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:33.991; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.001; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:54916/solr
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.001; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.002; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.004; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6a9ff65c name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.005; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.007; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.010; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.011; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@830f014 name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.011; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:34.015; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.017; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60612_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.019; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:60612_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.022; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.023; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.023; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.022; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.022; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.024; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.023; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.024; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.023; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.029; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.029; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.030; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.030; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.032; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.032; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.033; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.077; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.122; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.124; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.131; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.344; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.345; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:35652_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:35652/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "node_name":"127.0.0.1:35652_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.350; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.350; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.350; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.350; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.350; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.466; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.472; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.474; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.486; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.489; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.492; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:35.493; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:35.494; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.494; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:35.495; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:35.496; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.496; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.496; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1365786273898/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.496; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51418713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.497; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.497; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.497; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:35.497; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.498; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.499; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@50e7c3e7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14a85ba),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.499; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.501; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.501; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.502; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.502; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.503; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.503; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.503; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.504; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.504; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.506; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.508; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3e776828 main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.509; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.509; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.509; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.513; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3e776828 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.515; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:35.516; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.855; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.856; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60612/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:60612_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.856; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.856; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.860; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.860; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.860; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.860; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:36.860; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.517; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.517; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:60612/jd_p collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.520; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:60612/jd_p/collection1/ and leader is http://127.0.0.1:49204/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.521; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60612/jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.521; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.521; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.521; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.522; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.522; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.522; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.522; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.523; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.523; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.524; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.525; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.527; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:60612_jd_p_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.601; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.604; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:51172
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.604; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.605; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.605; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.605; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.606; org.apache.solr.core.CoreContainer; New CoreContainer 1257443140
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.606; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.606; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.626; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.627; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.627; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.627; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.628; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.628; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.628; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.629; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.629; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.629; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.635; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.644; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:54916/solr
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.645; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.646; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.647; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@79283989 name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.648; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.651; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.653; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.655; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1096afb1 name:ZooKeeperConnection Watcher:127.0.0.1:54916/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.655; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:37.660; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.364; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.365; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:60612_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60612/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:60612_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.369; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.528; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:60612_jd_p_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.528; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:60612_jd_p_collection1&nodeName=127.0.0.1:60612_jd_p&checkLive=true&state=recovering&action=PREPRECOVERY&version=2&onlyIfLeader=true&core=collection1&wt=javabin} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.662; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51172_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.664; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:51172_jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.666; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.666; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.667; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.669; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.669; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.673; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.673; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.674; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.674; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.675; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.676; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.676; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.701; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.730; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.731; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:38.736; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.070; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.076; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.079; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.091; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.094; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.097; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:39.098; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:39.099; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.100; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:39.100; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:39.101; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.101; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.101; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1365786277528/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.101; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51418713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.102; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.102; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.102; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:39.103; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.103; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.104; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e0d64c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a8a94b6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.104; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.106; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.106; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.107; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.107; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.108; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.108; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.108; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.108; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.109; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.111; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.113; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3358e36e main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.114; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.114; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.114; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.118; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3358e36e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.119; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.119; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.877; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.878; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51172/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:51172_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.879; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.879; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.885; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:39.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.121; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.121; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:51172/jd_p collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.126; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:51172/jd_p/collection1/ and leader is http://127.0.0.1:35652/jd_p/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.126; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51172/jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.126; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.126; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.127; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.127; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.127; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.127; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.127; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.128; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.129; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.129; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.129; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.132; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:51172_jd_p_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.132; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.133; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.136; org.apache.solr.core.CoreContainer; Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.136; org.apache.solr.cloud.ZkController; Check for collection zkNode:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.137; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.137; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.138; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.139; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.141; org.apache.solr.cloud.ZkController; Load collection config from:/collections/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.142; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/onenodecollectioncore/'
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.169; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.209; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.211; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.215; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.516; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.522; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.524; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.529; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:49204/jd_p/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.529; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:60612/jd_p START replicas=[http://127.0.0.1:49204/jd_p/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:40.530; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.530; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.531; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.531; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.531; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.532; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:49204/jd_p/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.532; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.536; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/get params={distrib=false&getVersions=100&qt=/get&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.536; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.538; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@698d5c80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a357166),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.539; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.540; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@698d5c80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a357166),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@698d5c80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a357166),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.541; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.542; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.543; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3e340f07 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.544; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.544; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/jd_p path=/update params={softCommit=false&commit=true&openSearcher=false&version=2&waitSearcher=true&wt=javabin&commit_end_point=true} {commit=} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.545; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.546; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.549; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.551; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.551; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/replication params={qt=/replication&version=2&wt=javabin&command=indexversion} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.552; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.552; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.552; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.553; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.554; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/replication params={qt=/replication&version=2&wt=javabin&generation=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.555; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:40.555; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:40.556; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.556; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index.20130413030440556
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.557; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.557; org.apache.solr.handler.SnapPuller; Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@51620528 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14077a36) fullCopy=false
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:40.559; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:40.560; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.561; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.561; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/replication params={checksum=true&qt=/replication&file=segments_2&wt=filestream&generation=2&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.561; org.apache.solr.core.SolrCore; [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1365786263789/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.562; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51418713
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.563; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.564; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.564; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.565; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.565; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.565; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection/index/
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:40.566; org.apache.solr.core.SolrCore; [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.567; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@50e7c3e7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14a85ba),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@50e7c3e7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14a85ba),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.568; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.568; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.569; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.570; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7246d57d main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.571; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7246d57d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.572; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e577a8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@256486d5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.572; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.572; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index.20130413030440556 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index.20130413030440556;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.573; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index.20130413030440556
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.574; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty3/index.20130413030440556
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.574; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.574; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.574; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.575; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.576; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.576; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.577; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.577; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.578; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.579; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.580; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.580; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.581; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.582; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.587; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.589; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2f6f8e9a main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.590; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection/tlog
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.590; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.590; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.593; org.apache.solr.core.SolrCore; [onenodecollectioncore] Registered new searcher Searcher@2f6f8e9a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:40.594; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.391; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.392; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:51172_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51172/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51172_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.398; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:60612_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:60612/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:60612_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.405; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.405; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection onenodecollection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.405; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.412; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.412; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.412; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.412; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.412; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.412; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.596; org.apache.solr.core.CoreContainer; registering core: onenodecollectioncore
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.596; org.apache.solr.cloud.ZkController; Register replica - core:onenodecollectioncore address:http://127.0.0.1:49204/jd_p collection:onenodecollection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.598; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.610; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.614; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.614; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.615; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:49204/jd_p/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.615; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.616; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:49204/jd_p/onenodecollectioncore/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.616; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:49204/jd_p/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:41.617; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.133; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:51172_jd_p_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.133; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:51172_jd_p_collection1&nodeName=127.0.0.1:51172_jd_p&checkLive=true&state=recovering&action=PREPRECOVERY&version=2&onlyIfLeader=true&core=collection1&wt=javabin} status=0 QTime=2001 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.924; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.937; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.937; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.938; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.937; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.937; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.938; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.981; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:49204/jd_p/onenodecollectioncore/ and leader is http://127.0.0.1:49204/jd_p/onenodecollectioncore/
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.982; org.apache.solr.cloud.ZkController; No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:49204/jd_p
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.982; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.983; org.apache.solr.cloud.ZkController; publishing core=onenodecollectioncore state=active
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.985; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.987; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={name=onenodecollectioncore&roles=none&numShards=1&collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167/onenodecollection&action=CREATE&version=2&wt=javabin} status=0 QTime=2851 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.988; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:42.989; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:43.992; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.134; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:35652/jd_p/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.135; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:51172/jd_p START replicas=[http://127.0.0.1:35652/jd_p/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:44.136; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.136; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.136; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.136; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.137; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.137; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:35652/jd_p/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.137; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.142; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/get params={distrib=false&getVersions=100&qt=/get&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.143; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.146; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ce1e8bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc61c2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.146; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.147; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ce1e8bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc61c2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ce1e8bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc61c2),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.148; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.148; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@6c46eb71 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.149; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.150; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/jd_p path=/update params={softCommit=false&commit=true&openSearcher=false&version=2&waitSearcher=true&wt=javabin&commit_end_point=true} {commit=} 0 7
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.151; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.151; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.153; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.154; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/replication params={qt=/replication&version=2&wt=javabin&command=indexversion} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.155; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.155; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.155; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.157; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/replication params={qt=/replication&version=2&wt=javabin&generation=2&command=filelist} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.158; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.159; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index.20130413030444158
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.159; org.apache.solr.handler.SnapPuller; Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1f2db40e lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f4c87a) fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.162; org.apache.solr.core.SolrCore; [collection1] webapp=/jd_p path=/replication params={checksum=true&qt=/replication&file=segments_2&wt=filestream&generation=2&command=filecontent} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.164; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.165; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.165; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.167; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e0d64c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a8a94b6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e0d64c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a8a94b6),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.168; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.168; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.168; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@e16d7bb main
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.170; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@e16d7bb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.171; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index.20130413030444158 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index.20130413030444158;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.171; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index.20130413030444158
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.171; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index.20130413030444158
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.172; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.172; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.172; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.172; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.174; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.461; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.462; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:49204_jd_p_onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.468; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:51172_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:51172/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "node_name":"127.0.0.1:51172_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.476; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.995; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.997; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: onenodecollection
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:44.998; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.041; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.043; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@27cf26e6 name:ZooKeeperConnection Watcher:127.0.0.1:54916 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.044; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:45741_jd_p (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:49204_jd_p (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:60612_jd_p (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:35652_jd_p (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:51172_jd_p (0)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89508168346435587-127.0.0.1:45741_jd_p-n_0000000000"}
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508168346435594-127.0.0.1:60612_jd_p-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508168346435596-127.0.0.1:51172_jd_p-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508168346435590-127.0.0.1:49204_jd_p-n_0000000001 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508168346435592-127.0.0.1:35652_jd_p-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89508168346435587-127.0.0.1:45741_jd_p-n_0000000000 (0)
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:49204_jd_p_collection1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:49204_jd_p",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:60612_jd_p_collection1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:60612/jd_p",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:60612_jd_p"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:35652_jd_p_collection1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:35652/jd_p",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:35652_jd_p",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:51172_jd_p_collection1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:51172/jd_p",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:51172_jd_p"}}}}},
[junit4:junit4]   1>         "onenodecollection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:49204_jd_p_onenodecollectioncore":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "roles":"none",
[junit4:junit4]   1>                   "collection":"onenodecollection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>                   "core":"onenodecollectioncore",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:49204_jd_p",
[junit4:junit4]   1>                   "leader":"true"}}}}},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:45741_jd_p_collection1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:45741/jd_p",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:45741_jd_p",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>   /solr/collections (3)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:35652/jd_p",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:35652_jd_p"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89508168346435594-127.0.0.1:60612_jd_p_collection1-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89508168346435590-127.0.0.1:49204_jd_p_collection1-n_0000000000 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89508168346435596-127.0.0.1:51172_jd_p_collection1-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89508168346435592-127.0.0.1:35652_jd_p_collection1-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/onenodecollection (2)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {
[junit4:junit4]   1>          "configName":"conf1",
[junit4:junit4]   1>          "router":"compositeId"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leaders (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>            "core":"onenodecollectioncore",
[junit4:junit4]   1>            "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1>     /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/onenodecollection/leader_elect/shard1/election/89508168346435590-127.0.0.1:49204_jd_p_onenodecollectioncore-n_0000000000 (0)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:45741/jd_p",
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:45741_jd_p"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89508168346435587-127.0.0.1:45741_jd_p_collection1-n_0000000000 (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.091; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 45741
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.092; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=2050774884
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.986; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.988; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:45741_jd_p_collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45741/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:45741_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.995; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.995; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.995; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.995; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:45.995; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.094; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.095; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.099; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2464d34f
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.104; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.105; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.105; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.106; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.107; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.107; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.108; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.109; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.109; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.110; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.111; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89508168346435587-127.0.0.1:45741_jd_p-n_0000000000) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.114; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:47.114; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:47.115; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.115; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.116; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.115; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.115; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.116; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.116; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.117; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.121; org.apache.solr.cloud.Overseer; Overseer (id=89508168346435590-127.0.0.1:49204_jd_p-n_0000000001) starting
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.129; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.130; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.130; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.131; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.134; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.136; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/jd_p,null}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.136; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:45741_jd_p_collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:45741/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:45741_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.142; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.142; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.142; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.142; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.188; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 49204
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:47.188; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=453853168
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:48.649; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:48.650; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:49204_jd_p_collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:48.656; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":"none",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:49204_jd_p_onenodecollectioncore",
[junit4:junit4]   1>   "collection":"onenodecollection",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:49204/jd_p",
[junit4:junit4]   1>   "core":"onenodecollectioncore",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "node_name":"127.0.0.1:49204_jd_p"}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:48.663; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating

[...truncated too long message...]

2.631; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:52.631; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:52.631; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.505; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.506; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.513; org.apache.solr.core.SolrCore; [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4f001211
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.522; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.523; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.524; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.525; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.527; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.528; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.528; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.529; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.530; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.530; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1365786260167/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.532; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89508168346435596-127.0.0.1:51172_jd_p-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.555; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/jd_p,null}
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.613; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.616; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:54916 54916
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1365786260167
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=101847F3B6A0DBFD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=in_ID -Dtests.timezone=Australia/NSW -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   33.5s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:35652/jd_p/onenodecollectioncore returned non ok status:404, message:Can not find: /jd_p/onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([101847F3B6A0DBFD:91FEC9EBC1FFBBC1]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.633; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 33476 T2042 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:53.729; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:53.729; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:53.730; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:54.834; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 17:04:54.834; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-12 17:04:54.834; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=in_ID, timezone=Australia/NSW
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=245641184,total=409993216
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrJ, SimplePostToolTest, TestMultiCoreConfBootstrap, FileUtilsTest, CoreContainerCoreInitFailuresTest, CurrencyFieldXmlFileTest, DirectSolrSpellCheckerTest, TestFiltering, TestCodecSupport, PathHierarchyTokenizerFactoryTest, PreAnalyzedUpdateProcessorTest, TestStressReorder, TestBM25SimilarityFactory, TestManagedSchema, TestSolrXMLSerializer, TestZkChroot, NoCacheHeaderTest, IndexReaderFactoryTest, DateMathParserTest, TestIndexingPerformance, TestSuggestSpellingConverter, TestFastOutputStream, CollectionsAPIDistributedZkTest, ChaosMonkeySafeLeaderTest, FullSolrCloudDistribCmdsTest, OpenCloseCoreStressTest, TestLMJelinekMercerSimilarityFactory, SolrCoreCheckLockOnStartupTest, DebugComponentTest, TestPartialUpdateDeduplication, TestSolr4Spatial, TestOmitPositions, TestAtomicUpdateErrorCases, TestDistributedSearch, TestUtils, SolrCmdDistributorTest, SortByFunctionTest, TestCollationField, TestReload, TestPostingsSolrHighlighter, BadIndexSchemaTest, TestWordDelimiterFilterFactory, CopyFieldTest, TestAnalyzedSuggestions, NotRequiredUniqueKeyTest, DisMaxRequestHandlerTest, TestStressLucene, TestDFRSimilarityFactory, TestCSVLoader, TestDistributedGrouping, TestLazyCores, JSONWriterTest, TestBinaryResponseWriter, DefaultValueUpdateProcessorTest, SpellPossibilityIteratorTest, CurrencyFieldOpenExchangeTest, ShardRoutingCustomTest, SolrIndexConfigTest, TestQueryTypes, OutputWriterTest, TimeZoneUtilsTest, SolrPluginUtilsTest, ClusterStateTest, PingRequestHandlerTest, SpellCheckComponentTest, TestRTGBase, DocValuesMultiTest, TestNumberUtils, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 34.75s, 1 test, 1 error <<< FAILURES!

[...truncated 476 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 1 error, 13 ignored (7 assumptions)

Total time: 36 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b84 -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b84) - Build # 5129 - Still Failing!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
I'm investigating the ShardSplitTest and ChaosMonkeyShardSplitTest
failures. I haven't been able to reproduce them locally but I'm going to
run them in a loop on ec2 instances with similar environment.


On Fri, Apr 12, 2013 at 9:20 PM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5129/
> Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC
>
> 2 tests failed.
> REGRESSION:
>  org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
>
> Error Message:
> shard2 is not consistent.  Got 48 from
> http://127.0.0.1:59509/_tiw/collection1lastClient and got 49 from
> http://127.0.0.1:43246/_tiw/collection1
>
> Stack Trace:
> java.lang.AssertionError: shard2 is not consistent.  Got 48 from
> http://127.0.0.1:59509/_tiw/collection1lastClient and got 49 from
> http://127.0.0.1:43246/_tiw/collection1
>         at
> __randomizedtesting.SeedInfo.seed([C679F89604E50FD3:479F768E73BA6FEF]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at
> org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
>         at
> org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:186)
>         at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:487)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:722)
>
>
> FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
>
> Error Message:
> Still found shard2 in collection test_unload_shard_and_collection
>
> Stack Trace:
> java.lang.AssertionError: Still found shard2 in collection
> test_unload_shard_and_collection
>         at
> __randomizedtesting.SeedInfo.seed([C679F89604E50FD3:479F768E73BA6FEF]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at
> org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
>         at
> org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
>         at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:487)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:722)
>
>
>
>
> Build Log:
> [...truncated 8897 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.036;
> org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system
> property: /_tiw/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.061;
> org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.064;
> org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
> [junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.067;
> org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.167;
> org.apache.solr.cloud.ZkTestServer; start zk server on port:55815
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.209;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.594;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1503c4aname:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.594;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.596;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.621;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.622;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1bc21b0name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.623;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.630;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.635;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/collection1/shards
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.639;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/control_collection
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.643;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/control_collection/shards
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.648;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.667;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.674;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml
> to /configs/conf1/schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.676;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.682;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.683;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/stopwords.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.687;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.688;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/protwords.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.692;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.693;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.697;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.698;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.704;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.706;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.711;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.713;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/old_synonyms.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.718;
> org.apache.solr.cloud.AbstractZkTestCase; put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.718;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /configs/conf1/synonyms.txt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.925;
> org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.019;
> org.eclipse.jetty.server.AbstractConnector; Started
> SelectChannelConnector@127.0.0.1:46610
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.042;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.060;
> org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr
> (NoInitialContextEx)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.061;
> org.apache.solr.core.SolrResourceLoader; using system property
> solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.073;
> org.apache.solr.core.CoreContainer$Initializer; looking for solr config
> file:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/solr.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.077;
> org.apache.solr.core.CoreContainer; New CoreContainer 22386157
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.077;
> org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.078;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.303;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> socketTimeout to: 120000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.304;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> urlScheme to: http://
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.305;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> connTimeout to: 15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.306;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxConnectionsPerHost to: 20
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.306;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> corePoolSize to: 0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.307;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maximumPoolSize to: 2147483647
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.308;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxThreadIdleTime to: 5
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.309;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> sizeOfQueue to: -1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.309;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> fairnessPolicy to: false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.325;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.521;
> org.apache.solr.core.CoreContainer; Registering Log Listener
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.553;
> org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.561;
> org.apache.solr.cloud.ZkController; zkHost includes chroot
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.563;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.567;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1e46b26name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.567;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.571;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.577;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.579;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1563813name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.579;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.584;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.593;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /overseer/collection-queue-work
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.602;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.605;
> org.apache.solr.cloud.ZkController; Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:46610__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.608;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /live_nodes/127.0.0.1:46610__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.615;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /overseer_elect/election
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.626;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.630;
> org.apache.solr.cloud.Overseer; Overseer
> (id=89507802784923651-127.0.0.1:46610__tiw-n_0000000000) starting
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.644;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.655;
> org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of
> collection creations
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.656;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.663;
> org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.666;
> org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.681;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the
> main queue
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.715;
> org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using
> instanceDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.715;
> org.apache.solr.cloud.ZkController; Check for collection
> zkNode:control_collection
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.717;
> org.apache.solr.cloud.ZkController; Collection zkNode exists
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.717;
> org.apache.solr.cloud.ZkController; Load collection config
> from:/collections/control_collection
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.720;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.721;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/lib/README'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.722;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/lib/classes/'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.791;
> org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.874;
> org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.884;
> org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.924;
> org.apache.solr.schema.IndexSchema; Schema name=test
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:24.788;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with
> rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:24.810;
> org.apache.solr.schema.IndexSchema; default search field in schema is text
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:24.813;
> org.apache.solr.schema.IndexSchema; unique key field: id
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.003;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.011;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.016;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.019;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.020;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.020;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.022;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.022;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.057;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.071;
> org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/,
> dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.074;
> org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding
> Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.132;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.153;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.154;
> org.apache.solr.core.SolrCore; New index directory detected: old=null
> new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index/
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.155;
> org.apache.solr.core.SolrCore; [collection1] Solr index directory
> './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index'
> doesn't exist. Creating new index...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.171;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.274;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.275;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.485;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.486;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "stored_sig"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.512;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "distrib-dup-test-chain-implicit"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.523;
> org.apache.solr.core.RequestHandlers; created standard:
> solr.StandardRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.529;
> org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.530;
> org.apache.solr.core.RequestHandlers; adding lazy requestHandler:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.531;
> org.apache.solr.core.RequestHandlers; created /replication:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.541;
> org.apache.solr.core.RequestHandlers; created /update:
> solr.UpdateRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.542;
> org.apache.solr.core.RequestHandlers; created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.578;
> org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.607;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@9b8977 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.633;
> org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.633;
> org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.683;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@9b8977 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.687;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.688;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.691;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.692;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=1 message={
> [junit4:junit4]   1>   "collection":"control_collection",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"1",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:46610/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":null,
> [junit4:junit4]   1>   "core_node_name":null,
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"down",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:46610__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.692;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection
> control_collection with numShards 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.701;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to
> shard=shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.712;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.690;
> org.apache.solr.core.CoreContainer; registering core: collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.691;
> org.apache.solr.cloud.ZkController; Register replica - core:collection1
> address:http://127.0.0.1:46610/_tiw collection:control_collection
> shard:shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.698;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.705;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/control_collection/leader_elect/shard1/election
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.720;
> org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader
> process.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.726;
> org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to
> continue.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.727;
> org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader -
> try and sync
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.728;
> org.apache.solr.cloud.SyncStrategy; Sync replicas to
> http://127.0.0.1:46610/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.729;
> org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.729;
> org.apache.solr.cloud.SyncStrategy;
> http://127.0.0.1:46610/_tiw/collection1/ has no replicas
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.729;
> org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader:
> http://127.0.0.1:46610/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.730;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/control_collection/leaders/shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.219;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.235;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.294;
> org.apache.solr.cloud.ZkController; We are
> http://127.0.0.1:46610/_tiw/collection1/ and leader is
> http://127.0.0.1:46610/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.296;
> org.apache.solr.cloud.ZkController; No LogReplay needed for
> core=collection1 baseURL=http://127.0.0.1:46610/_tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.296;
> org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.297;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.297;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.300;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.303;
> org.apache.solr.servlet.SolrDispatchFilter;
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.304;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.319;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.325;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.328;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.330;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1e78e8name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.330;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.333;
> org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.338;
> org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true
> cause connection loss:true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.406;
> org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.408;
> org.eclipse.jetty.server.AbstractConnector; Started
> SelectChannelConnector@127.0.0.1:59509
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.409;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.410;
> org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr
> (NoInitialContextEx)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.410;
> org.apache.solr.core.SolrResourceLoader; using system property
> solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.411;
> org.apache.solr.core.CoreContainer$Initializer; looking for solr config
> file:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/solr.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.411;
> org.apache.solr.core.CoreContainer; New CoreContainer 21798685
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.412;
> org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.412;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.442;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> socketTimeout to: 120000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.442;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> urlScheme to: http://
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.443;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> connTimeout to: 15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.443;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxConnectionsPerHost to: 20
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.444;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> corePoolSize to: 0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.445;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maximumPoolSize to: 2147483647
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.445;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxThreadIdleTime to: 5
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.446;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> sizeOfQueue to: -1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.447;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> fairnessPolicy to: false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.447;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.457;
> org.apache.solr.core.CoreContainer; Registering Log Listener
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.475;
> org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.476;
> org.apache.solr.cloud.ZkController; zkHost includes chroot
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.477;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.479;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1e8802cname:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.479;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.482;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.486;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.488;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1c2f1c5name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.488;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.494;
> org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.500;
> org.apache.solr.cloud.ZkController; Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:59509__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.503;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /live_nodes/127.0.0.1:59509__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.506;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.507;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.507;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.508;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.516;
> org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using
> instanceDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.517;
> org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.518;
> org.apache.solr.cloud.ZkController; Collection zkNode exists
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.518;
> org.apache.solr.cloud.ZkController; Load collection config
> from:/collections/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.520;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.520;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/lib/README'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.521;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/lib/classes/'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.565;
> org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.633;
> org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.636;
> org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.653;
> org.apache.solr.schema.IndexSchema; Schema name=test
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.749;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.750;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=1 message={
> [junit4:junit4]   1>   "collection":"control_collection",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"1",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:46610/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard1",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:46610
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"active",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:46610__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.757;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.757;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.757;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.633;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with
> rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.658;
> org.apache.solr.schema.IndexSchema; default search field in schema is text
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.662;
> org.apache.solr.schema.IndexSchema; unique key field: id
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.694;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.708;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.714;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.720;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.720;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.721;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.722;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.723;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.723;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.724;
> org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/,
> dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.724;
> org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding
> Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.728;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.729;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.730;
> org.apache.solr.core.SolrCore; New index directory detected: old=null
> new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index/
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.731;
> org.apache.solr.core.SolrCore; [collection1] Solr index directory
> './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index'
> doesn't exist. Creating new index...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.731;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.736;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.737;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.741;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.742;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "stored_sig"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.743;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "distrib-dup-test-chain-implicit"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.745;
> org.apache.solr.core.RequestHandlers; created standard:
> solr.StandardRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.746;
> org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.747;
> org.apache.solr.core.RequestHandlers; adding lazy requestHandler:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.747;
> org.apache.solr.core.RequestHandlers; created /replication:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.749;
> org.apache.solr.core.RequestHandlers; created /update:
> solr.UpdateRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.750;
> org.apache.solr.core.RequestHandlers; created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.754;
> org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.773;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@10ad000 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.774;
> org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.774;
> org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.789;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@10ad000 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.794;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.795;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.265;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.267;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:59509/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":null,
> [junit4:junit4]   1>   "core_node_name":null,
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"down",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:59509__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.268;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection
> collection1 with numShards 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.268;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to
> shard=shard2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.273;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.273;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.273;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.797;
> org.apache.solr.core.CoreContainer; registering core: collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.798;
> org.apache.solr.cloud.ZkController; Register replica - core:collection1
> address:http://127.0.0.1:59509/_tiw collection:collection1 shard:shard2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.800;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/collection1/leader_elect/shard2/election
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.810;
> org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader
> process.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.814;
> org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to
> continue.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.814;
> org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader -
> try and sync
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.815;
> org.apache.solr.cloud.SyncStrategy; Sync replicas to
> http://127.0.0.1:59509/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.815;
> org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.815;
> org.apache.solr.cloud.SyncStrategy;
> http://127.0.0.1:59509/_tiw/collection1/ has no replicas
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.816;
> org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader:
> http://127.0.0.1:59509/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.816;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/collection1/leaders/shard2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.778;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.824;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.824;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.824;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.878;
> org.apache.solr.cloud.ZkController; We are
> http://127.0.0.1:59509/_tiw/collection1/ and leader is
> http://127.0.0.1:59509/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.878;
> org.apache.solr.cloud.ZkController; No LogReplay needed for
> core=collection1 baseURL=http://127.0.0.1:59509/_tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.878;
> org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.879;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.879;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.881;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.883;
> org.apache.solr.servlet.SolrDispatchFilter;
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.883;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.884;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.954;
> org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.957;
> org.eclipse.jetty.server.AbstractConnector; Started
> SelectChannelConnector@127.0.0.1:57989
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.958;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.958;
> org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr
> (NoInitialContextEx)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.958;
> org.apache.solr.core.SolrResourceLoader; using system property
> solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.959;
> org.apache.solr.core.CoreContainer$Initializer; looking for solr config
> file:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/solr.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.959;
> org.apache.solr.core.CoreContainer; New CoreContainer 16774223
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.960;
> org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.960;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.987;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> socketTimeout to: 120000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.988;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> urlScheme to: http://
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.988;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> connTimeout to: 15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.989;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxConnectionsPerHost to: 20
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.990;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> corePoolSize to: 0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.990;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maximumPoolSize to: 2147483647
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.991;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxThreadIdleTime to: 5
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.992;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> sizeOfQueue to: -1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.992;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> fairnessPolicy to: false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.993;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.006;
> org.apache.solr.core.CoreContainer; Registering Log Listener
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.026;
> org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.027;
> org.apache.solr.cloud.ZkController; zkHost includes chroot
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.028;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.030;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1055be6name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.031;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.035;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.043;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.044;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@4ec89dname:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.045;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.050;
> org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.056;
> org.apache.solr.cloud.ZkController; Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:57989__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.057;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /live_nodes/127.0.0.1:57989__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.060;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.060;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.060;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.061;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.062;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.063;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.064;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.068;
> org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using
> instanceDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.068;
> org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.070;
> org.apache.solr.cloud.ZkController; Collection zkNode exists
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.071;
> org.apache.solr.cloud.ZkController; Load collection config
> from:/collections/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.073;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.075;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/lib/README'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.076;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/lib/classes/'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.120;
> org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.186;
> org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.188;
> org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.200;
> org.apache.solr.schema.IndexSchema; Schema name=test
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.336;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.337;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:59509/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard2",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:59509
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"active",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:59509__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.342;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.345;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.345;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.345;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.810;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with
> rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.818;
> org.apache.solr.schema.IndexSchema; default search field in schema is text
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.824;
> org.apache.solr.schema.IndexSchema; unique key field: id
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.847;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.851;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.856;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.858;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.858;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.859;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.860;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.861;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.861;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.862;
> org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/,
> dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.862;
> org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding
> Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.863;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.863;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.864;
> org.apache.solr.core.SolrCore; New index directory detected: old=null
> new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index/
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.864;
> org.apache.solr.core.SolrCore; [collection1] Solr index directory
> './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index'
> doesn't exist. Creating new index...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.865;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.869;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.869;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.876;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.876;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "stored_sig"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.878;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "distrib-dup-test-chain-implicit"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.879;
> org.apache.solr.core.RequestHandlers; created standard:
> solr.StandardRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.880;
> org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.881;
> org.apache.solr.core.RequestHandlers; adding lazy requestHandler:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.881;
> org.apache.solr.core.RequestHandlers; created /replication:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.883;
> org.apache.solr.core.RequestHandlers; created /update:
> solr.UpdateRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.883;
> org.apache.solr.core.RequestHandlers; created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.887;
> org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.890;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1aae13c main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.891;
> org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.891;
> org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.901;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.902;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.906;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@1aae13c main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.895;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.896;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:57989/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":null,
> [junit4:junit4]   1>   "core_node_name":null,
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"down",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:57989__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.897;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already
> exists with numShards=2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.897;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to
> shard=shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.907;
> org.apache.solr.core.CoreContainer; registering core: collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.907;
> org.apache.solr.cloud.ZkController; Register replica - core:collection1
> address:http://127.0.0.1:57989/_tiw collection:collection1 shard:shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.908;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/collection1/leader_elect/shard1/election
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.915;
> org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader
> process.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.918;
> org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to
> continue.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.918;
> org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader -
> try and sync
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.918;
> org.apache.solr.cloud.SyncStrategy; Sync replicas to
> http://127.0.0.1:57989/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.919;
> org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.919;
> org.apache.solr.cloud.SyncStrategy;
> http://127.0.0.1:57989/_tiw/collection1/ has no replicas
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.920;
> org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader:
> http://127.0.0.1:57989/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.920;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /collections/collection1/leaders/shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.408;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.480;
> org.apache.solr.cloud.ZkController; We are
> http://127.0.0.1:57989/_tiw/collection1/ and leader is
> http://127.0.0.1:57989/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.481;
> org.apache.solr.cloud.ZkController; No LogReplay needed for
> core=collection1 baseURL=http://127.0.0.1:57989/_tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.481;
> org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.482;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.482;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.486;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.488;
> org.apache.solr.servlet.SolrDispatchFilter;
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.489;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.490;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.573;
> org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.576;
> org.eclipse.jetty.server.AbstractConnector; Started
> SelectChannelConnector@127.0.0.1:43246
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.577;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.578;
> org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr
> (NoInitialContextEx)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.579;
> org.apache.solr.core.SolrResourceLoader; using system property
> solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.580;
> org.apache.solr.core.CoreContainer$Initializer; looking for solr config
> file:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/solr.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.581;
> org.apache.solr.core.CoreContainer; New CoreContainer 5536239
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.582;
> org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.583;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.614;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> socketTimeout to: 120000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.614;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> urlScheme to: http://
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.615;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> connTimeout to: 15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.615;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxConnectionsPerHost to: 20
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.616;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> corePoolSize to: 0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.616;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maximumPoolSize to: 2147483647
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.616;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxThreadIdleTime to: 5
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.617;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> sizeOfQueue to: -1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.618;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> fairnessPolicy to: false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.618;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.624;
> org.apache.solr.core.CoreContainer; Registering Log Listener
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.642;
> org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.642;
> org.apache.solr.cloud.ZkController; zkHost includes chroot
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.644;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.646;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@4e31afname:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.647;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.650;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.656;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.658;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@63db5cname:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.658;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.666;
> org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.673;
> org.apache.solr.cloud.ZkController; Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:43246__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.675;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /live_nodes/127.0.0.1:43246__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.680;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.681;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.682;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.682;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.682;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.683;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.685;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.684;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.686;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.699;
> org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using
> instanceDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.700;
> org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.701;
> org.apache.solr.cloud.ZkController; Collection zkNode exists
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.702;
> org.apache.solr.cloud.ZkController; Load collection config
> from:/collections/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.705;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.706;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/lib/README'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.707;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/lib/classes/'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.751;
> org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.811;
> org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.814;
> org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.821;
> org.apache.solr.schema.IndexSchema; Schema name=test
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.941;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.942;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:57989/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard1",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:57989
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"active",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:57989__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.947;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.412;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with
> rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.420;
> org.apache.solr.schema.IndexSchema; default search field in schema is text
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.423;
> org.apache.solr.schema.IndexSchema; unique key field: id
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.456;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.464;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.469;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.472;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.473;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.473;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.476;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.476;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.477;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.478;
> org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/,
> dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.478;
> org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding
> Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.479;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.480;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.481;
> org.apache.solr.core.SolrCore; New index directory detected: old=null
> new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index/
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.482;
> org.apache.solr.core.SolrCore; [collection1] Solr index directory
> './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index'
> doesn't exist. Creating new index...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.483;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.487;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.487;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.492;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.493;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "stored_sig"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.495;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "distrib-dup-test-chain-implicit"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.496;
> org.apache.solr.core.RequestHandlers; created standard:
> solr.StandardRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.498;
> org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.498;
> org.apache.solr.core.RequestHandlers; adding lazy requestHandler:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.499;
> org.apache.solr.core.RequestHandlers; created /replication:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.501;
> org.apache.solr.core.RequestHandlers; created /update:
> solr.UpdateRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.501;
> org.apache.solr.core.RequestHandlers; created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.508;
> org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.515;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1840859 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.516;
> org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.517;
> org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.526;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@1840859 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.532;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.532;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.472;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.474;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:43246/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":null,
> [junit4:junit4]   1>   "core_node_name":null,
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"down",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:43246__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.475;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already
> exists with numShards=2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.475;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to
> shard=shard2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.535;
> org.apache.solr.core.CoreContainer; registering core: collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.536;
> org.apache.solr.cloud.ZkController; Register replica - core:collection1
> address:http://127.0.0.1:43246/_tiw collection:collection1 shard:shard2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.542;
> org.apache.solr.cloud.ZkController; We are
> http://127.0.0.1:43246/_tiw/collection1/ and leader is
> http://127.0.0.1:59509/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.543;
> org.apache.solr.cloud.ZkController; No LogReplay needed for
> core=collection1 baseURL=http://127.0.0.1:43246/_tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.544;
> org.apache.solr.cloud.ZkController; Core needs to recover:collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.545;
> org.apache.solr.update.DefaultSolrCoreState; Running recovery - first
> canceling any ongoing recovery
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.555;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.557;
> org.apache.solr.servlet.SolrDispatchFilter;
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.558;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.559;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.562;
> org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.
>  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.563;
> org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.563;
> org.apache.solr.cloud.ZkController; publishing core=collection1
> state=recovering
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.564;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.567;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.645;
> org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.647;
> org.eclipse.jetty.server.AbstractConnector; Started
> SelectChannelConnector@127.0.0.1:59468
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.648;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.649;
> org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr
> (NoInitialContextEx)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.649;
> org.apache.solr.core.SolrResourceLoader; using system property
> solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.650;
> org.apache.solr.core.CoreContainer$Initializer; looking for solr config
> file:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/solr.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.650;
> org.apache.solr.core.CoreContainer; New CoreContainer 6075545
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.650;
> org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.651;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.686;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> socketTimeout to: 120000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.687;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> urlScheme to: http://
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.688;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> connTimeout to: 15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.688;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxConnectionsPerHost to: 20
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.689;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> corePoolSize to: 0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.689;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maximumPoolSize to: 2147483647
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.690;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> maxThreadIdleTime to: 5
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.690;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> sizeOfQueue to: -1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.691;
> org.apache.solr.handler.component.HttpShardHandlerFactory; Setting
> fairnessPolicy to: false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.691;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.702;
> org.apache.solr.core.CoreContainer; Registering Log Listener
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.716;
> org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.717;
> org.apache.solr.cloud.ZkController; zkHost includes chroot
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.720;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.722;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1b7548ename:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.723;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.725;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.729;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.730;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1f96543name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.731;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.737;
> org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.852;
> org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for
> coreNodeName: 127.0.0.1:43246__tiw_collection1, state: recovering,
> checkLive: true, onlyIfLeader: true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.741;
> org.apache.solr.cloud.ZkController; Register node as live in
> ZooKeeper:/live_nodes/127.0.0.1:59468__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.744;
> org.apache.solr.common.cloud.SolrZkClient; makePath:
> /live_nodes/127.0.0.1:59468__tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.748;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.752;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.752;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.766;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.766;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.754;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.772;
> org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using
> instanceDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.772;
> org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.774;
> org.apache.solr.cloud.ZkController; Collection zkNode exists
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.774;
> org.apache.solr.cloud.ZkController; Load collection config
> from:/collections/collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.777;
> org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for
> directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/'
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.778;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/lib/README'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.779;
> org.apache.solr.core.SolrResourceLoader; Adding
> 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/lib/classes/'
> to classloader
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.839;
> org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.894;
> org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.897;
> org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.904;
> org.apache.solr.schema.IndexSchema; Schema name=test
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.995;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.996;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:43246/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard2",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:43246
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"recovering",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:43246__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.575;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with
> rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.587;
> org.apache.solr.schema.IndexSchema; default search field in schema is text
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.592;
> org.apache.solr.schema.IndexSchema; unique key field: id
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.632;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.640;
> org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates
> from file currency.xml
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.647;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.649;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.650;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.650;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange
> rates from open-exchange-rates.json
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.652;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Unknown key IMPORTANT NOTE
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.653;
> org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates;
> Expected key, got STRING
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.654;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.654;
> org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/,
> dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.655;
> org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding
> Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.656;
> org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.657;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.658;
> org.apache.solr.core.SolrCore; New index directory detected: old=null
> new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index/
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.658;
> org.apache.solr.core.SolrCore; [collection1] Solr index directory
> './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index'
> doesn't exist. Creating new index...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.659;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.664;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.665;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.669;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.670;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "stored_sig"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.671;
> org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting
> DistributedUpdateProcessorFactory into updateRequestProcessorChain
> "distrib-dup-test-chain-implicit"
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.672;
> org.apache.solr.core.RequestHandlers; created standard:
> solr.StandardRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.674;
> org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.674;
> org.apache.solr.core.RequestHandlers; adding lazy requestHandler:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.675;
> org.apache.solr.core.RequestHandlers; created /replication:
> solr.ReplicationHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.680;
> org.apache.solr.core.RequestHandlers; created /update:
> solr.UpdateRequestHandler
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.681;
> org.apache.solr.core.RequestHandlers; created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.686;
> org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.692;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1140e1 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.693;
> org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.694;
> org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.704;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@1140e1 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.706;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.706;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.853;
> org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName:
> 127.0.0.1:43246__tiw_collection1, state: recovering, checkLive: true,
> onlyIfLeader: true for: 2 seconds.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.854;
> org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null
> path=/admin/cores params={coreNodeName=127.0.0.1:43246
> __tiw_collection1&core=collection1&version=2&nodeName=127.0.0.1:43246__tiw&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&wt=javabin&state=recovering}
> status=0 QTime=2005
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.512;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.514;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:59468/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":null,
> [junit4:junit4]   1>   "core_node_name":null,
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"down",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:59468__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.515;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already
> exists with numShards=2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.515;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to
> shard=shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.690;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.690;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.708;
> org.apache.solr.core.CoreContainer; registering core: collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.709;
> org.apache.solr.cloud.ZkController; Register replica - core:collection1
> address:http://127.0.0.1:59468/_tiw collection:collection1 shard:shard1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.715;
> org.apache.solr.cloud.ZkController; We are
> http://127.0.0.1:59468/_tiw/collection1/ and leader is
> http://127.0.0.1:57989/_tiw/collection1/
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.716;
> org.apache.solr.cloud.ZkController; No LogReplay needed for
> core=collection1 baseURL=http://127.0.0.1:59468/_tiw
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.716;
> org.apache.solr.cloud.ZkController; Core needs to recover:collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.717;
> org.apache.solr.update.DefaultSolrCoreState; Running recovery - first
> canceling any ongoing recovery
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.718;
> org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.
>  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.719;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.721;
> org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.722;
> org.apache.solr.cloud.ZkController; publishing core=collection1
> state=recovering
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.723;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.724;
> org.apache.solr.servlet.SolrDispatchFilter;
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.725;
> org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.725;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.726;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.741;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.742;
> org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for
> coreNodeName: 127.0.0.1:59468__tiw_collection1, state: recovering,
> checkLive: true, onlyIfLeader: true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.746;
> org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to
> finish - wait 15 for each attempt
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.746;
> org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to
> finish - collection: collection1 failOnTimeout:true timeout (sec):15
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.748;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.752;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.913;
> org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from
> http://127.0.0.1:59509/_tiw/collection1/ core=collection1 -
> recoveringAfterStartup=true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.919;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.927;
> org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=
> http://127.0.0.1:43246/_tiw START replicas=[
> http://127.0.0.1:59509/_tiw/collection1/] nUpdates=100
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:44.931;
> org.apache.solr.update.PeerSync; no frame of reference to tell of we've
> missed updates
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.932;
> org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not
> successful - trying replication. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.932;
> org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery.
> core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.933;
> org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates.
> core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.933;
> org.apache.solr.update.UpdateLog; Starting to buffer updates.
> FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.933;
> org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from
> http://127.0.0.1:59509/_tiw/collection1/. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.934;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.962;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/get
> params={getVersions=100&qt=/get&version=2&distrib=false&wt=javabin}
> status=0 QTime=3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.971;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.974;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.974;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.030;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.031;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.032;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@f79a64 realtime
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.032;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.037;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit_end_point=true&commit=true&version=2&openSearcher=false&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 78
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.058;
> org.apache.solr.handler.ReplicationHandler; Commits will be reserved for
>  10000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.059;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.065;
> org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer
> Task not started.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.082;
> org.apache.solr.handler.ReplicationHandler; Commits will be reserved for
>  10000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.083;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication
> params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0
> QTime=16
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.084;
> org.apache.solr.handler.SnapPuller; Master's generation: 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.084;
> org.apache.solr.handler.SnapPuller; Slave's generation: 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.084;
> org.apache.solr.handler.SnapPuller; Starting replication process
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.088;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication
> params={qt=/replication&version=2&command=filelist&wt=javabin&generation=2}
> status=0 QTime=0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.090;
> org.apache.solr.handler.SnapPuller; Number of files in latest index in
> master: 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.091;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.092;
> org.apache.solr.handler.SnapPuller; Starting download to
> org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e15fc2fullCopy=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.098;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication
> params={checksum=true&qt=/replication&file=segments_2&command=filecontent&wt=filestream&generation=2}
> status=0 QTime=2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.104;
> org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.117;
> org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.118;
> org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is
> unused... core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.120;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.121;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.121;
> org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be
> used.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.122;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@10566ba main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.125;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@10566ba main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.129;
> org.apache.solr.core.CachingDirectoryFactory; looking to close
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
> [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091;done=true>>]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.130;
> org.apache.solr.core.CachingDirectoryFactory; Closing directory:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.130;
> org.apache.solr.core.CachingDirectoryFactory; Removing directory before
> core close:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.135;
> org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.135;
> org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful
> - registering as Active. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.136;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.136;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.138;
> org.apache.solr.cloud.RecoveryStrategy; Finished recovery process.
> core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.201;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.202;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:59468/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard1",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:59468
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"recovering",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:59468__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.207;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:43246/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard2",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:43246
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"active",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:43246__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.744;
> org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName:
> 127.0.0.1:59468__tiw_collection1, state: recovering, checkLive: true,
> onlyIfLeader: true for: 2 seconds.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.744;
> org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null
> path=/admin/cores params={coreNodeName=127.0.0.1:59468
> __tiw_collection1&core=collection1&version=2&nodeName=127.0.0.1:59468__tiw&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&wt=javabin&state=recovering}
> status=0 QTime=2002
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.755;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:46.757;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.746;
> org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from
> http://127.0.0.1:57989/_tiw/collection1/ core=collection1 -
> recoveringAfterStartup=true
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.746;
> org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=
> http://127.0.0.1:59468/_tiw START replicas=[
> http://127.0.0.1:57989/_tiw/collection1/] nUpdates=100
> [junit4:junit4]   1> WARN  - 2013-04-12 15:31:47.748;
> org.apache.solr.update.PeerSync; no frame of reference to tell of we've
> missed updates
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.748;
> org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not
> successful - trying replication. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.749;
> org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery.
> core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.749;
> org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates.
> core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.749;
> org.apache.solr.update.UpdateLog; Starting to buffer updates.
> FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.750;
> org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from
> http://127.0.0.1:57989/_tiw/collection1/. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.751;
> org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client,
> config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.763;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.765;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/get
> params={getVersions=100&qt=/get&version=2&distrib=false&wt=javabin}
> status=0 QTime=1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.768;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.771;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.771;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.840;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.841;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.842;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@155c348realtime
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.842;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.843;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit_end_point=true&commit=true&version=2&openSearcher=false&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 76
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.845;
> org.apache.solr.handler.ReplicationHandler; Commits will be reserved for
>  10000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.847;
> org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer
> Task not started.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.851;
> org.apache.solr.handler.ReplicationHandler; Commits will be reserved for
>  10000
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.852;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication
> params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0
> QTime=2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.853;
> org.apache.solr.handler.SnapPuller; Master's generation: 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.853;
> org.apache.solr.handler.SnapPuller; Slave's generation: 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.854;
> org.apache.solr.handler.SnapPuller; Starting replication process
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.857;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication
> params={qt=/replication&version=2&command=filelist&wt=javabin&generation=2}
> status=0 QTime=1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.858;
> org.apache.solr.handler.SnapPuller; Number of files in latest index in
> master: 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.859;
> org.apache.solr.core.CachingDirectoryFactory; return new directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.860;
> org.apache.solr.handler.SnapPuller; Starting download to
> org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@179c064fullCopy=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.866;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication
> params={checksum=true&qt=/replication&file=segments_2&command=filecontent&wt=filestream&generation=2}
> status=0 QTime=0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.868;
> org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.881;
> org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.881;
> org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is
> unused... core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.883;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.884;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.884;
> org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be
> used.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.885;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1e2f834 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.886;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@1e2f834 main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.888;
> org.apache.solr.core.CachingDirectoryFactory; looking to close
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
> [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859;done=true>>]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.888;
> org.apache.solr.core.CachingDirectoryFactory; Closing directory:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.888;
> org.apache.solr.core.CachingDirectoryFactory; Removing directory before
> core close:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889;
> org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889;
> org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful
> - registering as Active. core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889;
> org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.892;
> org.apache.solr.cloud.RecoveryStrategy; Finished recovery process.
> core=collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.235;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.237;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=2 message={
> [junit4:junit4]   1>   "collection":"collection1",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"collection1",
> [junit4:junit4]   1>   "numShards":"2",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:59468/_tiw",
> [junit4:junit4]   1>   "shard_state":"active",
> [junit4:junit4]   1>   "shard":"shard1",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:59468
> __tiw_collection1",
> [junit4:junit4]   1>   "shard_range":null,
> [junit4:junit4]   1>   "state":"active",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:59468__tiw"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.766;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.770;
> org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished -
> collection: collection1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.777;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.781;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit:
> commits:num=1
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.781;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.830;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.831;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.832;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@cc0abc main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.832;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.834;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@cc0abc main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.835;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit=true&version=2&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 58
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.845;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.860;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.861;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.862;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1a0b4 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.862;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.864;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@1a0b4 main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.873;
> org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode:
> http://127.0.0.1:57989/_tiw/collection1/, StdNode:
> http://127.0.0.1:59468/_tiw/collection1/, StdNode:
> http://127.0.0.1:43246/_tiw/collection1/]
> params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.880;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.886;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.892;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.893;
> org.apache.solr.update.DirectUpdateHandler2; start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.893;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.895;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@816ac8 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.896;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.897;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@816ac8 main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.897;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit_end_point=true&commit=true&expungeDeletes=false&version=2&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 17
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.900;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.900;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.901;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@13f0f6f main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.902;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.903;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@13f0f6f main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.904;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit_end_point=true&commit=true&expungeDeletes=false&version=2&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 18
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.910;
> org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit:
> commits:num=2
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4]   1>
>  commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.910;
> org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.912;
> org.apache.solr.search.SolrIndexSearcher; Opening Searcher@87d8b0 main
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.912;
> org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.913;
> org.apache.solr.core.SolrCore; [collection1] Registered new searcher
> Searcher@87d8b0 main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.914;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit_end_point=true&commit=true&expungeDeletes=false&version=2&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 21
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.915;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={commit=true&version=2&waitSearcher=true&softCommit=false&wt=javabin}
> {commit=} 0 70
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.916;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.975;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select
> params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*}
> hits=0 status=0 QTime=52
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.980;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select
> params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*}
> hits=0 status=0 QTime=0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.984;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select
> params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*}
> hits=0 status=0 QTime=0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.987;
> org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select
> params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*}
> hits=0 status=0 QTime=0
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:50.988;
> org.apache.solr.common.cloud.ConnectionManager; Waiting for client to
> connect to ZooKeeper
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:50.991;
> org.apache.solr.common.cloud.ConnectionManager; Watcher
> org.apache.solr.common.cloud.ConnectionManager@1db44a1name:ZooKeeperConnection Watcher:
> 127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None
> path:null path:null type:None
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:50.992;
> org.apache.solr.common.cloud.ConnectionManager; Client is connected to
> ZooKeeper
> [junit4:junit4]   1> / (2)
> [junit4:junit4]   1> DATA:
> [junit4:junit4]   1>
> [junit4:junit4]   1>  /solr (7)
> [junit4:junit4]   1>   /solr/overseer_elect (2)
> [junit4:junit4]   1>    /solr/overseer_elect/election (5)
> [junit4:junit4]   1>
> /solr/overseer_elect/election/89507802784923660-127.0.0.1:59468__tiw-n_0000000004
> (0)
> [junit4:junit4]   1>
> /solr/overseer_elect/election/89507802784923658-127.0.0.1:43246__tiw-n_0000000003
> (0)
> [junit4:junit4]   1>
> /solr/overseer_elect/election/89507802784923656-127.0.0.1:57989__tiw-n_0000000002
> (0)
> [junit4:junit4]   1>
> /solr/overseer_elect/election/89507802784923651-127.0.0.1:46610__tiw-n_0000000000
> (0)
> [junit4:junit4]   1>
> /solr/overseer_elect/election/89507802784923654-127.0.0.1:59509__tiw-n_0000000001
> (0)
> [junit4:junit4]   1>    /solr/overseer_elect/leader (0)
> [junit4:junit4]   1>    DATA:
> [junit4:junit4]   1>
>  {"id":"89507802784923651-127.0.0.1:46610__tiw-n_0000000000"}
> [junit4:junit4]   1>   /solr/aliases.json (0)
> [junit4:junit4]   1>   /solr/live_nodes (5)
> [junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:59509__tiw (0)
> [junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:46610__tiw (0)
> [junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:59468__tiw (0)
> [junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:57989__tiw (0)
> [junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:43246__tiw (0)
> [junit4:junit4]   1>   /solr/overseer (3)
> [junit4:junit4]   1>   DATA:
> [junit4:junit4]   1>
> [junit4:junit4]   1>    /solr/overseer/queue-work (0)
> [junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
> [junit4:junit4]   1>    /solr/overseer/queue (0)
> [junit4:junit4]   1>   /solr/collections (2)
> [junit4:junit4]   1>    /solr/collections/control_collection (3)
> [junit4:junit4]   1>    DATA:
> [junit4:junit4]   1>        {"configName":"conf1"}
> [junit4:junit4]   1>     /solr/collections/control_collection/leader_elect
> (1)
> [junit4:junit4]   1>
>  /solr/collections/control_collection/leader_elect/shard1 (1)
> [junit4:junit4]   1>
> /solr/collections/control_collection/leader_elect/shard1/election (1)
> [junit4:junit4]   1>
>  /solr/collections/control_collection/leader_elect/shard1/election/89507802784923651-127.0.0.1:46610__tiw_collection1-n_0000000000
> (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
> [junit4:junit4]   1>
>  /solr/collections/control_collection/leaders/shard1 (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:46610/_tiw",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:46610__tiw"}
> [junit4:junit4]   1>    /solr/collections/collection1 (3)
> [junit4:junit4]   1>    DATA:
> [junit4:junit4]   1>        {"configName":"conf1"}
> [junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
> [junit4:junit4]   1>
>  /solr/collections/collection1/leader_elect/shard2 (1)
> [junit4:junit4]   1>
> /solr/collections/collection1/leader_elect/shard2/election (2)
> [junit4:junit4]   1>
>  /solr/collections/collection1/leader_elect/shard2/election/89507802784923654-127.0.0.1:59509__tiw_collection1-n_0000000000
> (0)
> [junit4:junit4]   1>
>  /solr/collections/collection1/leader_elect/shard2/election/89507802784923658-127.0.0.1:43246__tiw_collection1-n_0000000001
> (0)
> [junit4:junit4]   1>
>  /solr/collections/collection1/leader_elect/shard1 (1)
> [junit4:junit4]   1>
> /solr/collections/collection1/leader_elect/shard1/election (2)
> [junit4:junit4]   1>
>  /solr/collections/collection1/leader_elect/shard1/election/89507802784923660-127.0.0.1:59468__tiw_collection1-n_0000000001
> (0)
> [junit4:junit4]   1>
>  /solr/collections/collection1/leader_elect/shard1/election/89507802784923656-127.0.0.1:57989__tiw_collection1-n_0000000000
> (0)
> [junit4:junit4]   1>     /solr/collections/collection1/shards (0)
> [junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
> [junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:59509/_tiw",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:59509__tiw"}
> [junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:57989/_tiw",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:57989__tiw"}
> [junit4:junit4]   1>   /solr/configs (1)
> [junit4:junit4]   1>    /solr/configs/conf1 (9)
> [junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
> [junit4:junit4]   1>     DATA:
> [junit4:junit4]   1>         {
> [junit4:junit4]   1>           "disclaimer": "This data is not real, it
> was synthetically created to match currency.xml.  It is modeled after the
> data format available from openexchangerates.org.  See
> https://openexchangerates.org/documentation for details",
> [junit4:junit4]   1>           "license": "
> http://www.apache.org/licenses/LICENSE-2.0",
> [junit4:junit4]   1>           "timestamp": 1332070464,
> [junit4:junit4]   1>
> [junit4:junit4]   1>
> [junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to
> work, this data must be kept in sync with ./currency.xml",
> [junit4:junit4]   1>
> [junit4:junit4]   1>
> [junit4:junit4]   1>           "base": "USD",
> [junit4:junit4]   1>           "rates": {
> [junit4:junit4]   1>             "USD": 1,
> [junit4:junit4]   1>             "JPY": 81.29,
> [junit4:junit4]   1>             "EUR": 2.5,
> [junit4:junit4]   1>             "GBP": 0.5,
> [junit4:junit4]   1>             "MXN": 2.0
> [junit4:junit4]   1>           }
> [junit4:junit4]   1>         }
> [junit4:junit4]   1>
> [junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt
> (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
> [junit4:junit4]   1>     DATA: ...supressed...
> [junit4:junit4]   1>   /solr/clusterstate.json (0)
> [junit4:junit4]   1>   DATA:
> [junit4:junit4]   1>       {
> [junit4:junit4]   1>         "control_collection":{
> [junit4:junit4]   1>           "router":"compositeId",
> [junit4:junit4]   1>           "shards":{"shard1":{
> [junit4:junit4]   1>               "range":"80000000-7fffffff",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "replicas":{"127.0.0.1:46610
> __tiw_collection1":{
> [junit4:junit4]   1>                   "collection":"control_collection",
> [junit4:junit4]   1>                   "core":"collection1",
> [junit4:junit4]   1>                   "base_url":"
> http://127.0.0.1:46610/_tiw",
> [junit4:junit4]   1>                   "shard":"shard1",
> [junit4:junit4]   1>                   "state":"active",
> [junit4:junit4]   1>                   "node_name":"127.0.0.1:46610__tiw",
> [junit4:junit4]   1>                   "leader":"true"}}}}},
> [junit4:junit4]   1>         "collection1":{
> [junit4:junit4]   1>           "router":"compositeId",
> [junit4:junit4]   1>           "shards":{
> [junit4:junit4]   1>             "shard1":{
> [junit4:junit4]   1>               "range":"80000000-ffffffff",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "replicas":{
> [junit4:junit4]   1>                 "127.0.0.1:57989__tiw_collection1":{
> [junit4:junit4]   1>                   "collection":"collection1",
> [junit4:junit4]   1>                   "core":"collection1",
> [junit4:junit4]   1>                   "base_url":"
> http://127.0.0.1:57989/_tiw",
> [junit4:junit4]   1>                   "shard":"shard1",
> [junit4:junit4]   1>                   "state":"active",
> [junit4:junit4]   1>                   "node_name":"127.0.0.1:57989__tiw",
> [junit4:junit4]   1>                   "leader":"true"},
> [junit4:junit4]   1>                 "127.0.0.1:59468__tiw_collection1":{
> [junit4:junit4]   1>                   "collection":"collection1",
> [junit4:junit4]   1>                   "core":"collection1",
> [junit4:junit4]   1>                   "base_url":"
> http://127.0.0.1:59468/_tiw",
> [junit4:junit4]   1>                   "shard":"shard1",
> [junit4:junit4]   1>                   "state":"active",
> [junit4:junit4]   1>                   "node_name":"127.0.0.1:59468
> __tiw"}}},
> [junit4:junit4]   1>             "shard2":{
> [junit4:junit4]   1>               "range":"0-7fffffff",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "replicas":{
> [junit4:junit4]   1>                 "127.0.0.1:59509__tiw_collection1":{
> [junit4:junit4]   1>                   "collection":"collection1",
> [junit4:junit4]   1>                   "core":"collection1",
> [junit4:junit4]   1>                   "base_url":"
> http://127.0.0.1:59509/_tiw",
> [junit4:junit4]   1>                   "shard":"shard2",
> [junit4:junit4]   1>                   "state":"active",
> [junit4:junit4]   1>                   "node_name":"127.0.0.1:59509__tiw",
> [junit4:junit4]   1>                   "leader":"true"},
> [junit4:junit4]   1>                 "127.0.0.1:43246__tiw_collection1":{
> [junit4:junit4]   1>                   "collection":"collection1",
> [junit4:junit4]   1>                   "core":"collection1",
> [junit4:junit4]   1>                   "base_url":"
> http://127.0.0.1:43246/_tiw",
> [junit4:junit4]   1>                   "shard":"shard2",
> [junit4:junit4]   1>                   "state":"active",
> [junit4:junit4]   1>                   "node_name":"127.0.0.1:43246
> __tiw"}}}}}}
> [junit4:junit4]   1>  /zookeeper (1)
> [junit4:junit4]   1>  DATA:
> [junit4:junit4]   1>
> [junit4:junit4]   1>
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.232;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&update.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin&_version_=-1432124875031445504}
> {deleteByQuery=*:* (-1432124875031445504)} 0 4
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.233;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&update.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin&_version_=-1432124875057659904}
> {deleteByQuery=*:* (-1432124875057659904)} 0 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.234;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update
> params={update.distrib=TOLEADER&version=2&wt=javabin} {deleteByQuery=*:*
> (-1432124875057659904)} 0 6
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.235;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {deleteByQuery=*:*
> (-1432124875031445504)} 0 120
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.289;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[0
> (1432124875076534272)]} 0 47
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.315;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[0
> (1432124875130011648)]} 0 12
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.316;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[0
> (1432124875130011648)]} 0 18
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.317;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[0]} 0 24
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.325;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[1
> (1432124875155177472)]} 0 4
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.335;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[1
> (1432124875161468928)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.336;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[1
> (1432124875161468928)]} 0 8
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.340;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[2
> (1432124875173003264)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.378;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[2
> (1432124875177197568)]} 0 5
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.380;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[2
> (1432124875177197568)]} 0 37
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.384;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[3
> (1432124875219140608)]} 0 1
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.397;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[3
> (1432124875225432064)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.399;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[3
> (1432124875225432064)]} 0 11
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.405;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[4
> (1432124875240112128)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.417;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[4
> (1432124875246403584)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.418;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[4
> (1432124875246403584)]} 0 9
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.426;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[5
> (1432124875261083648)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.440;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[5
> (1432124875269472256)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.441;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[5
> (1432124875269472256)]} 0 11
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.448;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[6
> (1432124875285200896)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.462;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[6
> (1432124875293589504)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.463;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[6
> (1432124875293589504)]} 0 10
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.465;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[6]} 0 15
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.471;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[7
> (1432124875309318144)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.486;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[7
> (1432124875318755328)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.488;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[7
> (1432124875318755328)]} 0 10
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.489;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[7]} 0 15
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.495;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[8
> (1432124875334483968)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.509;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[8
> (1432124875343921152)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.510;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[8
> (1432124875343921152)]} 0 8
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.512;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[8]} 0 13
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.518;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[9
> (1432124875358601216)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.529;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[9
> (1432124875364892672)]} 0 3
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.530;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[9
> (1432124875364892672)]} 0 9
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.536;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[10
> (1432124875377475584)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.550;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[10
> (1432124875386912768)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.551;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[10
> (1432124875386912768)]} 0 8
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.553;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[10]} 0 13
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.558;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[11
> (1432124875401592832)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.576;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[11
> (1432124875409981440)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.578;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=
> http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[11
> (1432124875409981440)]} 0 13
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.579;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[11]} 0 17
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.585;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[12
> (1432124875428855808)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.599;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=
> http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[12
> (1432124875438292992)]} 0 2
> [junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.600;
> org.apache.solr.update.processor.LogUpdateProcessor; [collection1]
> webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.fro
>
> [...truncated too long message...]
>
> : WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:22.559;
> org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 46326
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:22.560;
> org.apache.solr.core.CoreContainer; Shutting down CoreContainer
> instance=16718255
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.026;
> org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from
> ZooKeeper...
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.034;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state
> numShards=null message={
> [junit4:junit4]   1>   "collection":"unloadcollection",
> [junit4:junit4]   1>   "operation":"state",
> [junit4:junit4]   1>   "core":"unloadcollection4",
> [junit4:junit4]   1>   "base_url":"http://127.0.0.1:46326/_izf/uk",
> [junit4:junit4]   1>   "shard":"shard1",
> [junit4:junit4]   1>   "core_node_name":"127.0.0.1:46326
> __izf%2Fuk_unloadcollection4",
> [junit4:junit4]   1>   "state":"down",
> [junit4:junit4]   1>   "roles":null,
> [junit4:junit4]   1>   "node_name":"127.0.0.1:46326__izf%2Fuk"}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.040;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.040;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.562;
> org.apache.solr.cloud.ZkController; publishing core=unloadcollection4
> state=down
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.563;
> org.apache.solr.cloud.ZkController; numShards not found on descriptor -
> reading it from system property
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.567;
> org.apache.solr.core.SolrCore; [unloadcollection4]  CLOSING SolrCore
> org.apache.solr.core.SolrCore@de78ff
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.581;
> org.apache.solr.update.DirectUpdateHandler2; closing
> DirectUpdateHandler2{commits=3,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.582;
> org.apache.solr.update.SolrCoreState; Closing SolrCoreState
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.582;
> org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has
> reached 0 - closing IndexWriter
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.583;
> org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with
> IndexWriterCloser
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.586;
> org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on
> request.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.587;
> org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory
> - 2 directories currently being tracked
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.587;
> org.apache.solr.core.CachingDirectoryFactory; looking to close
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n
> [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n;done=false>>]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.588;
> org.apache.solr.core.CachingDirectoryFactory; Closing directory:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.589;
> org.apache.solr.core.CachingDirectoryFactory; looking to close
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n/index.20130412093942952
> [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n/index.20130412093942952;done=false>>]
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.590;
> org.apache.solr.core.CachingDirectoryFactory; Closing directory:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n/index.20130412093942952
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.624;
> org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I
> (id=89507833231179788-127.0.0.1:46326__izf%2Fuk-n_0000000004) am no longer
> a leader.
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.625;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.627;
> org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.649;
> org.eclipse.jetty.server.handler.ContextHandler; stopped
> o.e.j.s.ServletContextHandler{/_izf/uk,null}
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.704;
> org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.708;
> org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:41093 41093
> [junit4:junit4]   2> Creating dataDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714
> [junit4:junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch
> -Dtests.seed=C679F89604E50FD3 -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=ar_QA -Dtests.timezone=America/Costa_Rica
> -Dtests.file.encoding=US-ASCII
> [junit4:junit4] FAILURE  139s J0 |
> UnloadDistributedZkTest.testDistribSearch <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found
> shard2 in collection test_unload_shard_and_collection
> [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([C679F89604E50FD3:479F768E73BA6FEF]:0)
> [junit4:junit4]    >    at
> org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
> [junit4:junit4]    >    at
> org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
> [junit4:junit4]    >    at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.836;
> org.apache.solr.SolrTestCaseJ4; ###deleteCore
> [junit4:junit4]   2> 139137 T1390 ccr.ThreadLeakControl.checkThreadLeaks
> WARNING Will linger awaiting termination of 3 leaked thread(s).
> [junit4:junit4]   1> WARN  - 2013-04-12 15:41:26.926;
> org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered,
> but Solr cannot talk to ZK
> [junit4:junit4]   1> INFO  - 2013-04-12 15:41:26.926;
> org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change:
> WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes,
> has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   1> WARN  - 2013-04-12 15:41:26.926;
> org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered,
> but Solr cannot talk to ZK
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene41,
> sim=DefaultSimilarity, locale=ar_QA, timezone=America/Costa_Rica
> [junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation
> 1.8.0-ea (32-bit)/cpus=8,threads=1,free=316670592,total=518979584
> [junit4:junit4]   2> NOTE: All tests run in this JVM:
> [ChaosMonkeyShardSplitTest, TestPerFieldSimilarity, TestFastWriter,
> TestPhraseSuggestions, StatelessScriptUpdateProcessorFactoryTest,
> TestSolrQueryParserDefaultOperatorResource, TestPropInjectDefaults,
> TestDocumentBuilder, TestPHPSerializedResponseWriter, OverseerTest,
> LegacyHTMLStripCharFilterTest, MinimalSchemaTest, TestSolrCoreProperties,
> ShardRoutingTest, DistributedSpellCheckComponentTest, TestBadConfig,
> BadComponentTest, TestJoin, TestPseudoReturnFields, ClusterStateUpdateTest,
> TestTrie, TestRandomDVFaceting, RAMDirectoryFactoryTest, TestConfig,
> SliceStateUpdateTest, UnloadDistributedZkTest]
> [junit4:junit4] Completed on J0 in 140.43s, 1 test, 1 failure <<< FAILURES!
>
> [...truncated 601 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875:
> There were test failures: 289 suites, 1200 tests, 2 failures, 13 ignored (7
> assumptions)
>
> Total time: 50 minutes 38 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 32bit/jdk1.8.0-ea-b84 -client
> -XX:+UseConcMarkSweepGC
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



-- 
Regards,
Shalin Shekhar Mangar.

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b84) - Build # 5129 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5129/
Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch

Error Message:
shard2 is not consistent.  Got 48 from http://127.0.0.1:59509/_tiw/collection1lastClient and got 49 from http://127.0.0.1:43246/_tiw/collection1

Stack Trace:
java.lang.AssertionError: shard2 is not consistent.  Got 48 from http://127.0.0.1:59509/_tiw/collection1lastClient and got 49 from http://127.0.0.1:43246/_tiw/collection1
	at __randomizedtesting.SeedInfo.seed([C679F89604E50FD3:479F768E73BA6FEF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
	at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:186)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([C679F89604E50FD3:479F768E73BA6FEF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8897 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.036; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /_tiw/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.061; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.064; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.067; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.167; org.apache.solr.cloud.ZkTestServer; start zk server on port:55815
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.209; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.594; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1503c4a name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.594; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.596; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.621; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.622; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1bc21b0 name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.623; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.630; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.635; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.639; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.643; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.648; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.667; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.674; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.676; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.682; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.683; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.687; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.688; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.692; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.693; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.697; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.698; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.704; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.706; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.711; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.713; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.718; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.718; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:22.925; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.019; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46610
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.042; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.060; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.061; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.073; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.077; org.apache.solr.core.CoreContainer; New CoreContainer 22386157
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.077; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.078; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.303; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.304; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.305; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.306; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.306; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.307; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.308; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.309; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.309; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.325; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.521; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.553; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.561; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.563; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.567; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1e46b26 name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.567; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.571; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.577; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.579; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1563813 name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.579; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.584; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.593; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.602; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.605; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46610__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.608; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46610__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.615; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.626; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.630; org.apache.solr.cloud.Overseer; Overseer (id=89507802784923651-127.0.0.1:46610__tiw-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.644; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.655; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.656; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.663; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.666; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.681; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.715; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.715; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.717; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.717; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.720; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.721; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.722; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.791; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.874; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.884; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:23.924; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:24.788; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:24.810; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:24.813; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.003; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.011; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.016; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.019; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.020; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.020; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.022; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.022; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.057; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.071; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1365780682726/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.074; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.132; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.153; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.154; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:25.155; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.171; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.274; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.275; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.485; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.486; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.512; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.523; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.529; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.530; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.531; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.541; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.542; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.578; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.607; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@9b8977 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.633; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.633; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.683; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@9b8977 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.687; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:25.688; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.691; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.692; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46610/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:46610__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.692; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.701; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:26.712; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.690; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.691; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:46610/_tiw collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.698; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.705; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.720; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.726; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.727; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.728; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:46610/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.729; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.729; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:46610/_tiw/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.729; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:46610/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:27.730; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.219; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.235; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.294; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:46610/_tiw/collection1/ and leader is http://127.0.0.1:46610/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.296; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46610/_tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.296; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.297; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.297; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.300; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.303; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.304; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.319; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.325; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.328; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.330; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1e78e8 name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.330; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.333; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.338; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.406; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.408; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:59509
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.409; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.410; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.410; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.411; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.411; org.apache.solr.core.CoreContainer; New CoreContainer 21798685
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.412; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.412; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.442; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.442; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.443; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.443; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.444; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.445; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.445; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.446; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.447; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.447; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.457; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.475; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.476; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.477; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.479; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1e8802c name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.479; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.482; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.486; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.488; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1c2f1c5 name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.488; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:28.494; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.500; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59509__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.503; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:59509__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.506; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.507; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.507; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.508; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.516; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.517; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.518; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.518; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.520; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.520; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.521; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.565; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.633; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.636; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.653; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.749; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.750; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46610/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:46610__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:46610__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.757; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.757; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:29.757; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.633; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.658; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.662; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.694; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.708; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.714; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.720; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.720; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.721; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.722; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.723; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.723; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.724; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1365780688338/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.724; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.728; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.729; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.730; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:30.731; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.731; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.736; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.737; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.741; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.742; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.743; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.745; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.746; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.747; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.747; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.749; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.750; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.754; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.773; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@10ad000 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.774; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.774; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.789; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@10ad000 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.794; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:30.795; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.265; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.267; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59509/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59509__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.268; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.268; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.273; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.273; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.273; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.797; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.798; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:59509/_tiw collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.800; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.810; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.814; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.814; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.815; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:59509/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.815; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.815; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:59509/_tiw/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.816; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:59509/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:31.816; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.778; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.824; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.824; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.824; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.878; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:59509/_tiw/collection1/ and leader is http://127.0.0.1:59509/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.878; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59509/_tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.878; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.879; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.879; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.881; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.883; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.883; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.884; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.954; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.957; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:57989
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.958; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.958; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.958; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.959; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.959; org.apache.solr.core.CoreContainer; New CoreContainer 16774223
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.960; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.960; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.987; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.988; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.988; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.989; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.990; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.990; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.991; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.992; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.992; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:32.993; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.006; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.026; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.027; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.028; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.030; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1055be6 name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.031; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.035; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.043; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.044; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4ec89d name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.045; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:33.050; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.056; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57989__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.057; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:57989__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.061; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.062; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.063; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.064; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.068; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.068; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.070; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.071; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.073; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.075; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.076; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.120; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.186; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.188; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.200; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.336; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.337; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59509/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:59509__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59509__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.342; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.345; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.345; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.345; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.810; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.818; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.824; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.847; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.851; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.856; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.858; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.858; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.859; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.860; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.861; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.861; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.862; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1365780692888/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.862; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.863; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.863; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.864; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:34.864; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.865; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.869; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.869; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.876; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.876; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.878; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.879; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.880; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.881; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.881; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.883; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.883; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.887; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.890; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1aae13c main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.891; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.891; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.901; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.902; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:34.906; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1aae13c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.895; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.896; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:57989/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:57989__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.897; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.897; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.901; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.907; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.907; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:57989/_tiw collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.908; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.915; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.918; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.918; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.918; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:57989/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.919; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.919; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:57989/_tiw/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.920; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:57989/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:35.920; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.408; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.426; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.480; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:57989/_tiw/collection1/ and leader is http://127.0.0.1:57989/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.481; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57989/_tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.481; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.482; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.482; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.486; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.488; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.489; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.490; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.573; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.576; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:43246
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.577; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.578; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.579; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.580; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.581; org.apache.solr.core.CoreContainer; New CoreContainer 5536239
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.582; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.583; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.614; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.614; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.615; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.615; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.617; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.618; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.618; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.624; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.642; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.642; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.644; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.646; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4e31af name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.647; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.650; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.656; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.658; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@63db5c name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.658; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:37.666; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.673; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43246__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.675; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:43246__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.680; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.681; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.682; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.682; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.682; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.683; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.685; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.684; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.686; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.699; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.700; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.701; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.702; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.705; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.706; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.707; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.751; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.811; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.814; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.821; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.941; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.942; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:57989/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:57989__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:57989__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.947; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:38.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.412; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.420; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.423; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.456; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.464; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.469; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.472; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.473; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.473; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.476; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.476; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.477; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.478; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1365780697498/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.478; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.479; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.480; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.481; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:39.482; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.483; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.487; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.487; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.492; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.493; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.495; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.496; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.498; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.498; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.499; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.501; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.501; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.508; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.515; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1840859 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.516; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.517; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.526; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1840859 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.532; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:39.532; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.472; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.474; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:43246/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:43246__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.475; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.475; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.484; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.535; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.536; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:43246/_tiw collection:collection1 shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.542; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:43246/_tiw/collection1/ and leader is http://127.0.0.1:59509/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.543; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43246/_tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.544; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.545; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.555; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.557; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.558; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.559; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.562; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.563; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.563; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.564; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.567; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.645; org.eclipse.jetty.server.Server; jetty-8.1.8.v20121106
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.647; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:59468
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.648; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.649; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.649; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.650; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.650; org.apache.solr.core.CoreContainer; New CoreContainer 6075545
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.650; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.651; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.686; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.687; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.688; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.688; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.689; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.689; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.690; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.690; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.691; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.691; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.702; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.716; org.apache.solr.core.CoreContainer; Zookeeper client=127.0.0.1:55815/solr
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.717; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.720; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.722; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1b7548e name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.723; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.725; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.729; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.730; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f96543 name:ZooKeeperConnection Watcher:127.0.0.1:55815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.731; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.737; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:40.852; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:43246__tiw_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.741; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59468__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.744; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:59468__tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.748; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.752; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.752; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.751; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.766; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.766; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.754; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.772; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.772; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.774; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.774; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.777; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.778; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.779; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.839; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.894; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.897; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.904; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.995; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:41.996; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:43246/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:43246__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:43246__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.005; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.575; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.587; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.592; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.632; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.640; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.647; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.649; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.650; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.650; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.652; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.653; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.654; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.654; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1365780700567/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.655; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@137f87e
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.656; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.657; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.658; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:42.658; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.659; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.664; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.665; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.669; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.670; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.671; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.672; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.674; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.674; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.675; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.680; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.681; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.686; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.692; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1140e1 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.693; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.694; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.704; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1140e1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.706; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.706; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.853; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:43246__tiw_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:42.854; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:43246__tiw_collection1&core=collection1&version=2&nodeName=127.0.0.1:43246__tiw&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&wt=javabin&state=recovering} status=0 QTime=2005 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.512; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.514; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59468/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59468__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.515; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.515; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.691; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.708; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.709; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:59468/_tiw collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.715; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:59468/_tiw/collection1/ and leader is http://127.0.0.1:57989/_tiw/collection1/
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.716; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59468/_tiw
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.716; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.717; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.718; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.719; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.721; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.722; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.723; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.724; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.725; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.725; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.726; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.741; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.742; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:59468__tiw_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.746; org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.746; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:43.748; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.752; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.913; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:59509/_tiw/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.919; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.927; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:43246/_tiw START replicas=[http://127.0.0.1:59509/_tiw/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:44.931; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.932; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.932; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.933; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.933; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.933; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:59509/_tiw/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.934; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.962; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/get params={getVersions=100&qt=/get&version=2&distrib=false&wt=javabin} status=0 QTime=3 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.971; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.974; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:44.974; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.030; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.031; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.032; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@f79a64 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.032; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.037; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit_end_point=true&commit=true&version=2&openSearcher=false&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 78
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.058; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.059; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.065; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.082; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.083; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=16 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.084; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.084; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.084; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.088; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication params={qt=/replication&version=2&command=filelist&wt=javabin&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.090; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.091; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.092; org.apache.solr.handler.SnapPuller; Starting download to org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e15fc2 fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.098; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication params={checksum=true&qt=/replication&file=segments_2&command=filecontent&wt=filestream&generation=2} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.104; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.117; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.118; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.120; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.121; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.121; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.122; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@10566ba main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.125; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@10566ba main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.129; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.130; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.130; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index.20130413023145091
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.135; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.135; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.136; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.136; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.138; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.201; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.202; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59468/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:59468__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59468__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.207; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:43246/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:43246__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:43246__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.225; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.744; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:59468__tiw_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.744; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:59468__tiw_collection1&core=collection1&version=2&nodeName=127.0.0.1:59468__tiw&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&wt=javabin&state=recovering} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:45.755; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:46.757; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.746; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:57989/_tiw/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.746; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:59468/_tiw START replicas=[http://127.0.0.1:57989/_tiw/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-12 15:31:47.748; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.748; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.749; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.749; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.749; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.750; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:57989/_tiw/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.751; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.763; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.765; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/get params={getVersions=100&qt=/get&version=2&distrib=false&wt=javabin} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.768; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.771; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.771; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.840; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.841; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.842; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@155c348 realtime
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.842; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.843; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit_end_point=true&commit=true&version=2&openSearcher=false&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 76
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.845; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.847; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.851; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.852; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=2 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.853; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.853; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.854; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.857; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication params={qt=/replication&version=2&command=filelist&wt=javabin&generation=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.858; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.859; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.860; org.apache.solr.handler.SnapPuller; Starting download to org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859 lockFactory=org.apache.lucene.store.NativeFSLockFactory@179c064 fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.866; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/replication params={checksum=true&qt=/replication&file=segments_2&command=filecontent&wt=filestream&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.868; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.881; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.881; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.883; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.884; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.884; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.885; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1e2f834 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.886; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1e2f834 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.888; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.888; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.888; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index.20130413023147859
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.889; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:47.892; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.235; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.237; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:59468/_tiw",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:59468__tiw_collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:59468__tiw"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.766; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.770; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: collection1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.777; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.781; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.781; org.apache.solr.core.SolrDeletionPolicy; newest commit = 1[segments_1]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.830; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/control/data/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.831; org.apache.solr.core.SolrDeletionPolicy; newest commit = 2[segments_2]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.832; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@cc0abc main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.832; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.834; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@cc0abc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.835; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit=true&version=2&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 58
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.845; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.860; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty1/index,segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.861; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.862; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1a0b4 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.862; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.864; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1a0b4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.873; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:57989/_tiw/collection1/, StdNode: http://127.0.0.1:59468/_tiw/collection1/, StdNode: http://127.0.0.1:43246/_tiw/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.880; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.886; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.892; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty2/index,segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.893; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.893; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.895; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@816ac8 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.896; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.897; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@816ac8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.897; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit_end_point=true&commit=true&expungeDeletes=false&version=2&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 17
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.900; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty3/index,segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.900; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.901; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@13f0f6f main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.902; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.903; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@13f0f6f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.904; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit_end_point=true&commit=true&expungeDeletes=false&version=2&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 18
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.910; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   1> 	commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1365780682062/jetty4/index,segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.910; org.apache.solr.core.SolrDeletionPolicy; newest commit = 3[segments_3]
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.912; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@87d8b0 main
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.912; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.913; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@87d8b0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.914; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit_end_point=true&commit=true&expungeDeletes=false&version=2&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 21
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.915; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={commit=true&version=2&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 70
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.916; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.975; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*} hits=0 status=0 QTime=52 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.980; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.984; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:48.987; org.apache.solr.core.SolrCore; [collection1] webapp=/_tiw path=/select params={tests=checkShardConsistency&version=2&distrib=false&wt=javabin&rows=0&q=*:*} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:50.988; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:50.991; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1db44a1 name:ZooKeeperConnection Watcher:127.0.0.1:55815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:50.992; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> / (2)
[junit4:junit4]   1> DATA:
[junit4:junit4]   1>     
[junit4:junit4]   1>  /solr (7)
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (5)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507802784923660-127.0.0.1:59468__tiw-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507802784923658-127.0.0.1:43246__tiw-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507802784923656-127.0.0.1:57989__tiw-n_0000000002 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507802784923651-127.0.0.1:46610__tiw-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89507802784923654-127.0.0.1:59509__tiw-n_0000000001 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89507802784923651-127.0.0.1:46610__tiw-n_0000000000"}
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/live_nodes (5)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:59509__tiw (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:46610__tiw (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:59468__tiw (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:57989__tiw (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:43246__tiw (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>   /solr/collections (2)
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89507802784923651-127.0.0.1:46610__tiw_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:46610/_tiw",
[junit4:junit4]   1>            "node_name":"127.0.0.1:46610__tiw"}
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (2)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89507802784923654-127.0.0.1:59509__tiw_collection1-n_0000000000 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard2/election/89507802784923658-127.0.0.1:43246__tiw_collection1-n_0000000001 (0)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89507802784923660-127.0.0.1:59468__tiw_collection1-n_0000000001 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89507802784923656-127.0.0.1:57989__tiw_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (2)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:59509/_tiw",
[junit4:junit4]   1>            "node_name":"127.0.0.1:59509__tiw"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:57989/_tiw",
[junit4:junit4]   1>            "node_name":"127.0.0.1:57989__tiw"}
[junit4:junit4]   1>   /solr/configs (1)
[junit4:junit4]   1>    /solr/configs/conf1 (9)
[junit4:junit4]   1>     /solr/configs/conf1/protwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4]   1>     DATA:
[junit4:junit4]   1>         {
[junit4:junit4]   1>           "disclaimer": "This data is not real, it was synthetically created to match currency.xml.  It is modeled after the data format available from openexchangerates.org.  See https://openexchangerates.org/documentation for details",
[junit4:junit4]   1>           "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4]   1>           "timestamp": 1332070464,
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4]   1>         
[junit4:junit4]   1>         
[junit4:junit4]   1>           "base": "USD",
[junit4:junit4]   1>           "rates": {
[junit4:junit4]   1>             "USD": 1,
[junit4:junit4]   1>             "JPY": 81.29,
[junit4:junit4]   1>             "EUR": 2.5,
[junit4:junit4]   1>             "GBP": 0.5,
[junit4:junit4]   1>             "MXN": 2.0
[junit4:junit4]   1>           }
[junit4:junit4]   1>         }
[junit4:junit4]   1>         
[junit4:junit4]   1>     /solr/configs/conf1/currency.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/schema.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>     /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4]   1>     DATA: ...supressed...
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:46610__tiw_collection1":{
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:46610/_tiw",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:46610__tiw",
[junit4:junit4]   1>                   "leader":"true"}}}}},
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{
[junit4:junit4]   1>             "shard1":{
[junit4:junit4]   1>               "range":"80000000-ffffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:57989__tiw_collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:57989/_tiw",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:57989__tiw",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:59468__tiw_collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:59468/_tiw",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:59468__tiw"}}},
[junit4:junit4]   1>             "shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{
[junit4:junit4]   1>                 "127.0.0.1:59509__tiw_collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:59509/_tiw",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:59509__tiw",
[junit4:junit4]   1>                   "leader":"true"},
[junit4:junit4]   1>                 "127.0.0.1:43246__tiw_collection1":{
[junit4:junit4]   1>                   "collection":"collection1",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:43246/_tiw",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:43246__tiw"}}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.232; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&update.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin&_version_=-1432124875031445504} {deleteByQuery=*:* (-1432124875031445504)} 0 4
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.233; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&update.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin&_version_=-1432124875057659904} {deleteByQuery=*:* (-1432124875057659904)} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.234; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&version=2&wt=javabin} {deleteByQuery=*:* (-1432124875057659904)} 0 6
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.235; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {deleteByQuery=*:* (-1432124875031445504)} 0 120
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.289; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[0 (1432124875076534272)]} 0 47
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.315; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[0 (1432124875130011648)]} 0 12
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.316; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[0 (1432124875130011648)]} 0 18
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.317; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[0]} 0 24
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.325; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[1 (1432124875155177472)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.335; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[1 (1432124875161468928)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.336; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[1 (1432124875161468928)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.340; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[2 (1432124875173003264)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.378; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[2 (1432124875177197568)]} 0 5
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.380; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[2 (1432124875177197568)]} 0 37
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.384; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[3 (1432124875219140608)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.397; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[3 (1432124875225432064)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.399; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[3 (1432124875225432064)]} 0 11
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.405; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[4 (1432124875240112128)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.417; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[4 (1432124875246403584)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.418; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[4 (1432124875246403584)]} 0 9
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.426; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[5 (1432124875261083648)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.440; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[5 (1432124875269472256)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.441; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[5 (1432124875269472256)]} 0 11
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.448; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[6 (1432124875285200896)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.462; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[6 (1432124875293589504)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.463; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[6 (1432124875293589504)]} 0 10
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.465; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[6]} 0 15
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.471; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[7 (1432124875309318144)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.486; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[7 (1432124875318755328)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.488; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[7 (1432124875318755328)]} 0 10
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.489; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[7]} 0 15
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.495; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[8 (1432124875334483968)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.509; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[8 (1432124875343921152)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.510; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[8 (1432124875343921152)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.512; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[8]} 0 13
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.518; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[9 (1432124875358601216)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.529; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[9 (1432124875364892672)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.530; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[9 (1432124875364892672)]} 0 9
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.536; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[10 (1432124875377475584)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.550; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[10 (1432124875386912768)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.551; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[10 (1432124875386912768)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.553; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[10]} 0 13
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.558; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[11 (1432124875401592832)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.576; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[11 (1432124875409981440)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.578; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:59509/_tiw/collection1/&version=2&wt=javabin} {add=[11 (1432124875409981440)]} 0 13
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.579; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[11]} 0 17
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.585; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={version=2&wt=javabin} {add=[12 (1432124875428855808)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.599; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:57989/_tiw/collection1/&version=2&wt=javabin} {add=[12 (1432124875438292992)]} 0 2
[junit4:junit4]   1> INFO  - 2013-04-12 15:31:51.600; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/_tiw path=/update params={update.distrib=TOLEADER&distrib.fro

[...truncated too long message...]

: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:22.559; org.apache.solr.cloud.ChaosMonkey; monkey: stop shard! 46326
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:22.560; org.apache.solr.core.CoreContainer; Shutting down CoreContainer instance=16718255
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.026; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.034; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=null message={
[junit4:junit4]   1>   "collection":"unloadcollection",
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core":"unloadcollection4",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:46326/_izf/uk",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:46326__izf%2Fuk_unloadcollection4",
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:46326__izf%2Fuk"}
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.040; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:24.040; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.562; org.apache.solr.cloud.ZkController; publishing core=unloadcollection4 state=down
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.563; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.567; org.apache.solr.core.SolrCore; [unloadcollection4]  CLOSING SolrCore org.apache.solr.core.SolrCore@de78ff
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.581; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.582; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.582; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.583; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.586; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.587; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.587; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.588; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.589; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n/index.20130412093942952 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n/index.20130412093942952;done=false>>]
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.590; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714/1365781169248unloadcollection_4n/index.20130412093942952
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.624; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89507833231179788-127.0.0.1:46326__izf%2Fuk-n_0000000004) am no longer a leader.
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.625; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.627; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.649; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/_izf/uk,null}
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.704; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.708; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:41093 41093
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1365781146714
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=C679F89604E50FD3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_QA -Dtests.timezone=America/Costa_Rica -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE  139s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([C679F89604E50FD3:479F768E73BA6FEF]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:25.836; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> 139137 T1390 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   1> WARN  - 2013-04-12 15:41:26.926; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   1> INFO  - 2013-04-12 15:41:26.926; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> WARN  - 2013-04-12 15:41:26.926; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_QA, timezone=America/Costa_Rica
[junit4:junit4]   2> NOTE: Linux 3.2.0-40-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=316670592,total=518979584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [ChaosMonkeyShardSplitTest, TestPerFieldSimilarity, TestFastWriter, TestPhraseSuggestions, StatelessScriptUpdateProcessorFactoryTest, TestSolrQueryParserDefaultOperatorResource, TestPropInjectDefaults, TestDocumentBuilder, TestPHPSerializedResponseWriter, OverseerTest, LegacyHTMLStripCharFilterTest, MinimalSchemaTest, TestSolrCoreProperties, ShardRoutingTest, DistributedSpellCheckComponentTest, TestBadConfig, BadComponentTest, TestJoin, TestPseudoReturnFields, ClusterStateUpdateTest, TestTrie, TestRandomDVFaceting, RAMDirectoryFactoryTest, TestConfig, SliceStateUpdateTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 140.43s, 1 test, 1 failure <<< FAILURES!

[...truncated 601 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1231: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:875: There were test failures: 289 suites, 1200 tests, 2 failures, 13 ignored (7 assumptions)

Total time: 50 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b84 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure