You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/05/03 04:11:54 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b86) - Build #
5405 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5405/
Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard2 in collection test_unload_shard_and_collection
Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
at __randomizedtesting.SeedInfo.seed([BE612AD4C4372CAF:3F87A4CCB3684C93]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:490)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9555 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.256; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /_qx/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.261; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.262; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.262; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.362; org.apache.solr.cloud.ZkTestServer; start zk server on port:43998
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.363; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.497; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@403c5fc6 name:ZooKeeperConnection Watcher:127.0.0.1:43998 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.497; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.498; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.507; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.509; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4efbb9b1 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.509; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.510; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.515; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.519; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.523; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.528; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.529; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.535; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.536; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.541; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.541; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.546; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.547; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.551; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.552; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.557; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.558; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.562; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.563; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.566; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.567; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.569; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.570; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.633; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.639; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:49052
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.640; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.640; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.641; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.641; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.641; org.apache.solr.core.CoreContainer; New CoreContainer 1435103005
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.653; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.653; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.689; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.690; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/collection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.691; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/collection1/conf
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.696; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/collection1/conf/xslt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.711; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/collection1/lib
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.712; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/collection1/lib/classes
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.713; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1367546500573/conf/core.properties, adding to cores
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.715; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.715; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.716; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.716; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.716; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.717; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.717; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.717; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.717; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.718; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.720; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.721; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:43998/solr
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.721; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.722; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.723; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@433aa10d name:ZooKeeperConnection Watcher:127.0.0.1:43998 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.724; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.726; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.728; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.729; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@61257c75 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.730; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.732; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.734; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.736; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.738; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49052__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.739; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:49052__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.741; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.747; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.748; org.apache.solr.cloud.Overseer; Overseer (id=89623527441367043-127.0.0.1:49052__qx-n_0000000000) starting
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.750; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.753; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.754; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.757; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.759; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.762; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.763; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.764; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.764; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.766; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.767; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.768; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1d8104d6 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.769; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.770; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.773; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.833; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.842; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:47098
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.842; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.843; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.843; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.843; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.844; org.apache.solr.core.CoreContainer; New CoreContainer 1195773043
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.844; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.844; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.878; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.878; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/collection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.879; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/collection1/conf
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.883; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/collection1/conf/xslt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.898; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/collection1/lib
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.898; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/collection1/lib/classes
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.900; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/conf/core.properties, adding to cores
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.901; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.902; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.902; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.902; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.903; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.903; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.903; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.904; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.904; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.904; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.907; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.907; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:43998/solr
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.907; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.908; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.910; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@438e23c1 name:ZooKeeperConnection Watcher:127.0.0.1:43998 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.910; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.913; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.915; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.917; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1242c08b name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.917; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:40.922; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.926; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47098__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.928; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:47098__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.933; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.933; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.933; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.937; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.938; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 02:01:41.938; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.002; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.011; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:41762
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.012; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.013; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.013; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.013; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.014; org.apache.solr.core.CoreContainer; New CoreContainer 1347586798
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.014; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.015; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.052; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.053; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/collection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.054; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/collection1/conf
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.058; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/collection1/conf/xslt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.072; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/collection1/lib
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.073; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/collection1/lib/classes
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.074; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/conf/core.properties, adding to cores
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.076; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.076; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.077; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.077; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.077; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.078; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.078; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.078; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.079; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.079; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.081; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.082; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:43998/solr
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.082; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.083; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.085; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@204c2f46 name:ZooKeeperConnection Watcher:127.0.0.1:43998 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.085; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.088; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.090; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.092; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@38040603 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.092; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:42.100; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.105; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41762__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.107; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:41762__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.113; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.113; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.113; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.113; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.121; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.121; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.122; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.192; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.196; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46013
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.196; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.197; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.198; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.198; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.199; org.apache.solr.core.CoreContainer; New CoreContainer 811238247
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.200; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.201; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.249; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.250; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/collection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.251; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/collection1/conf
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.255; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/collection1/conf/xslt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.269; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/collection1/lib
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.270; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/collection1/lib/classes
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.271; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/conf/core.properties, adding to cores
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.273; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.273; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.273; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.274; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.274; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.274; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.274; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.275; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.275; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.275; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.278; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.278; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:43998/solr
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.279; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.280; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.281; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4363de7 name:ZooKeeperConnection Watcher:127.0.0.1:43998 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.282; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.283; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.286; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.288; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@66646baa name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.288; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:43.293; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.296; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46013__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.297; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46013__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.300; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.301; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.301; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.301; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.300; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.305; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.305; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.305; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.370; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.373; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:48608
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.374; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.374; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.374; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.375; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.375; org.apache.solr.core.CoreContainer; New CoreContainer 800078853
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.375; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.376; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.417; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.417; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/collection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.418; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/collection1/conf
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.422; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/collection1/conf/xslt
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.437; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/collection1/lib
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.438; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/collection1/lib/classes
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.439; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1367546504307/conf/core.properties, adding to cores
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.440; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.441; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.441; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.441; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.442; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.442; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.442; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.443; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.443; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.443; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.446; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.446; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:43998/solr
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.446; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.447; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.449; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@25150db6 name:ZooKeeperConnection Watcher:127.0.0.1:43998 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.450; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.452; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.455; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.456; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@446df786 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.457; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:44.460; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.463; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48608__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.465; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:48608__qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.467; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.467; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.468; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.468; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.468; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.469; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.473; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.473; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.474; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.476; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.479; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/unloadcollection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.479; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.480; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.480; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.481; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.482; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.484; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.485; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/unloadcollection1/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.528; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.557; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.559; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.562; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.893; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.897; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.900; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.914; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.918; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.920; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 02:01:45.922; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 02:01:45.922; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.922; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 02:01:45.923; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 02:01:45.923; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.924; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.924; org.apache.solr.core.SolrCore; [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1367546500773/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.924; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16250044
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.925; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.925; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.926; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n/index/
[junit4:junit4] 1> WARN - 2013-05-03 02:01:45.926; org.apache.solr.core.SolrCore; [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.926; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n/index
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.928; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.929; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.931; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.932; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.932; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.933; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.934; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.934; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.935; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.935; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.936; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.940; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.943; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@73996edc main
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.944; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n/tlog
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.945; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.945; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.960; org.apache.solr.core.SolrCore; [unloadcollection1] Registered new searcher Searcher@73996edc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:45.962; org.apache.solr.cloud.ZkController; publishing core=unloadcollection1 state=down
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.777; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.779; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:47098__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47098/_qx",
[junit4:junit4] 1> "numShards":"1",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection1",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.779; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection unloadcollection with numShards 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.779; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.786; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.786; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.787; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.786; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.786; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.786; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.964; org.apache.solr.core.CoreContainer; registering core: unloadcollection1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.964; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection1 address:http://127.0.0.1:47098/_qx collection:unloadcollection shard:shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.965; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.973; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.976; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.976; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.976; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:47098/_qx/unloadcollection1/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.977; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.977; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:47098/_qx/unloadcollection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.977; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:47098/_qx/unloadcollection1/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:46.977; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.293; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.301; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.301; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.301; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.301; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.301; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.301; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.338; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:47098/_qx/unloadcollection1/ and leader is http://127.0.0.1:47098/_qx/unloadcollection1/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.338; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:47098/_qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.339; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.339; org.apache.solr.cloud.ZkController; publishing core=unloadcollection1 state=active
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.342; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.343; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546505478unloadcollection1_1n&collection=unloadcollection&numShards=1&action=CREATE&version=2&name=unloadcollection1} status=0 QTime=2864
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.344; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.346; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.347; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6e90c0a4 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.347; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.350; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.354; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.355; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.359; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.359; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.360; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.361; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.363; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/unloadcollection2/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.390; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.427; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.429; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.432; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.750; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.755; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.757; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.777; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.781; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.785; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 02:01:48.787; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 02:01:48.789; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.790; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 02:01:48.792; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 02:01:48.792; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.792; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.793; org.apache.solr.core.SolrCore; [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1367546501940/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.793; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16250044
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.794; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.795; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.795; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index/
[junit4:junit4] 1> WARN - 2013-05-03 02:01:48.796; org.apache.solr.core.SolrCore; [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.796; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.799; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c97c9ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@53899735),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.800; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.802; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.803; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.804; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.805; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.806; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.807; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.807; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.808; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.808; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.810; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.812; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4197decf main
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.812; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/tlog
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.813; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.813; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.817; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@4197decf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.819; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=down
[junit4:junit4] 1> INFO - 2013-05-03 02:01:48.819; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.809; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.810; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:47098__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47098/_qx",
[junit4:junit4] 1> "numShards":"1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:47098__qx_unloadcollection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection1",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.816; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:41762__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:41762/_qx",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection2",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.816; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.817; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:49.823; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.822; org.apache.solr.core.CoreContainer; registering core: unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.822; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection2 address:http://127.0.0.1:41762/_qx collection:unloadcollection shard:shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.828; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:41762/_qx/unloadcollection2/ and leader is http://127.0.0.1:47098/_qx/unloadcollection1/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.828; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:41762/_qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.829; org.apache.solr.cloud.ZkController; Core needs to recover:unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.829; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.830; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.831; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.831; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=recovering
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.831; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.831; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.833; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.833; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n&collection=unloadcollection&action=CREATE&version=2&name=unloadcollection2} status=0 QTime=2475
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.835; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.836; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.838; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:50.839; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:41762__qx_unloadcollection2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.334; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.336; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:41762__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:41762/_qx",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "state":"recovering",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:41762__qx_unloadcollection2",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection2",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.344; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.840; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:41762__qx_unloadcollection2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.841; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&nodeName=127.0.0.1:41762__qx&state=recovering&onlyIfLeader=true&action=PREPRECOVERY&checkLive=true&version=2&core=unloadcollection1&coreNodeName=127.0.0.1:41762__qx_unloadcollection2} status=0 QTime=1002
[junit4:junit4] 1> INFO - 2013-05-03 02:01:51.841; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:52.843; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.842; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:47098/_qx/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.842; org.apache.solr.update.PeerSync; PeerSync: core=unloadcollection2 url=http://127.0.0.1:41762/_qx START replicas=[http://127.0.0.1:47098/_qx/unloadcollection1/] nUpdates=100
[junit4:junit4] 1> WARN - 2013-05-03 02:01:53.843; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.843; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.843; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.843; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.844; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.844; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:47098/_qx/unloadcollection1/. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.844; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.846; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.851; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/get params={wt=javabin&qt=/get&getVersions=100&distrib=false&version=2} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.855; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.857; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.858; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.859; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.860; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.860; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@443530c realtime
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.861; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.861; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true&version=2&commit=true&waitSearcher=true} {commit=} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.862; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.863; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.870; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.871; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=7
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.872; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.872; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.872; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.874; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=javabin&qt=/replication&generation=2&version=2&command=filelist} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.875; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.876; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index.20130502220153875
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.877; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5a6602a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42eaed7f) fullCopy=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.879; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=2&checksum=true&file=segments_2&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.880; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.882; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.882; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.884; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c97c9ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@53899735),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c97c9ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@53899735),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.884; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.884; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.885; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@c3c993d main
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.886; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@c3c993d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.887; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index.20130502220153875 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index.20130502220153875;done=true>>]
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.887; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index.20130502220153875
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.888; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546508357unloadcollection1_2n/index.20130502220153875
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.888; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.888; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.889; org.apache.solr.cloud.ZkController; publishing core=unloadcollection2 state=active
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.889; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 02:01:53.891; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=unloadcollection2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.356; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.357; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:41762__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:41762/_qx",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:41762__qx_unloadcollection2",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection2",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.365; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.365; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.365; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.849; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.850; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.850; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.863; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[6 (1433976454359547904)]} 0 2
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.864; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[6 (1433976454359547904)]} 0 11
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.868; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[7 (1433976454372130816)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.869; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[7 (1433976454372130816)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.874; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[8 (1433976454377373696)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.874; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[8 (1433976454377373696)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.876; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.879; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.879; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.880; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2f834a9a main
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.881; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.882; org.apache.solr.core.SolrCore; [unloadcollection1] Registered new searcher Searcher@2f834a9a main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C3)}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.882; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:41762/_qx/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.884; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.886; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c97c9ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@53899735),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c97c9ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@53899735),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.887; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.888; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@25ae857a main
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.889; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.897; org.apache.solr.core.SolrCore; [unloadcollection2] Registered new searcher Searcher@25ae857a main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C3)}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.898; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&softCommit=false&commit_end_point=true&expungeDeletes=false&version=2&commit=true&waitSearcher=true} {commit=} 0 14
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.898; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&softCommit=false&version=2&commit=true&waitSearcher=true} {commit=} 0 22
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.899; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.903; org.apache.solr.core.CoreContainer; Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.903; org.apache.solr.cloud.ZkController; Check for collection zkNode:unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.904; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.904; org.apache.solr.cloud.ZkController; Load collection config from:/collections/unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.905; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/unloadcollection3/'
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.933; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.968; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.970; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:54.973; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.267; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.271; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.273; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.301; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.306; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.311; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 02:01:55.313; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 02:01:55.314; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.314; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 02:01:55.317; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 02:01:55.317; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.318; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.318; org.apache.solr.core.SolrCore; [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1367546503126/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.319; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16250044
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.320; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.321; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.321; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index/
[junit4:junit4] 1> WARN - 2013-05-03 02:01:55.322; org.apache.solr.core.SolrCore; [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.323; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.325; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@285bbbe1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4998156f),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.326; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.329; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.329; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.330; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.331; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.332; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.333; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.333; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.334; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.335; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.339; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.343; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@183500f9 main
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.344; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/tlog
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.344; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.344; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.349; org.apache.solr.core.SolrCore; [unloadcollection3] Registered new searcher Searcher@183500f9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.350; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=down
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.351; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.873; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.874; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:46013__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46013/_qx",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection3",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.874; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.875; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:55.882; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.353; org.apache.solr.core.CoreContainer; registering core: unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.354; org.apache.solr.cloud.ZkController; Register replica - core:unloadcollection3 address:http://127.0.0.1:46013/_qx collection:unloadcollection shard:shard1
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.361; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:46013/_qx/unloadcollection3/ and leader is http://127.0.0.1:47098/_qx/unloadcollection1/
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.361; org.apache.solr.cloud.ZkController; No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:46013/_qx
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.362; org.apache.solr.cloud.ZkController; Core needs to recover:unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.362; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.363; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.364; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.364; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=recovering
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.364; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.364; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.366; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.366; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n&collection=unloadcollection&action=CREATE&version=2&name=unloadcollection3} status=0 QTime=1464
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.367; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.369; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:56.373; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:46013__qx_unloadcollection3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.371; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.390; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.390; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:46013__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46013/_qx",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "state":"recovering",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:46013__qx_unloadcollection3",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection3",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:57.394; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:01:58.374; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:46013__qx_unloadcollection3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 1> INFO - 2013-05-03 02:01:58.374; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={wt=javabin&nodeName=127.0.0.1:46013__qx&state=recovering&onlyIfLeader=true&action=PREPRECOVERY&checkLive=true&version=2&core=unloadcollection1&coreNodeName=127.0.0.1:46013__qx_unloadcollection3} status=0 QTime=2001
[junit4:junit4] 1> INFO - 2013-05-03 02:01:58.374; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:01:59.378; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.375; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:47098/_qx/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.376; org.apache.solr.update.PeerSync; PeerSync: core=unloadcollection3 url=http://127.0.0.1:46013/_qx START replicas=[http://127.0.0.1:47098/_qx/unloadcollection1/] nUpdates=100
[junit4:junit4] 1> WARN - 2013-05-03 02:02:00.377; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.377; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.377; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.377; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.378; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.378; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:47098/_qx/unloadcollection1/. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.378; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.379; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/get params={wt=javabin&qt=/get&getVersions=100&distrib=false&version=2} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.381; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.384; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.385; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_3,generation=3}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d9bd156 lockFactory=org.apache.lucene.store.NativeFSLockFactory@539a0b86),segFN=segments_4,generation=4}
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.386; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.386; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.387; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true&version=2&commit=true&waitSearcher=true} {commit=} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.388; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.388; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.391; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.391; org.apache.solr.handler.SnapPuller; Master's generation: 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.392; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.392; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.394; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=javabin&qt=/replication&generation=4&version=2&command=filelist} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.395; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 21
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.397; org.apache.solr.core.CachingDirectoryFactory; return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index.20130502220200396
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.398; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1aa526c2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@410bc3c4) fullCopy=false
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.400; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_TestBloomFilteredLucene41Postings_0.blm&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.403; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Asserting_0.doc&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.406; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0.nvd&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.410; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Direct_0.tip&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.413; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_TestBloomFilteredLucene41Postings_0.tip&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.416; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=segments_4&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.419; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Asserting_0.tim&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.422; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_TestBloomFilteredLucene41Postings_0.tim&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.425; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0.nvm&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.428; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0.fnm&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.441; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_TestBloomFilteredLucene41Postings_0.doc&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.445; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0.fdt&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.448; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Asserting_0.tip&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.451; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0.si&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.454; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0.fdx&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.457; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Asserting_0.pos&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.461; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Direct_0.tim&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.464; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Memory_0.ram&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.467; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_TestBloomFilteredLucene41Postings_0.pos&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.470; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Direct_0.doc&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.473; org.apache.solr.core.SolrCore; [unloadcollection1] webapp=/_qx path=/replication params={wt=filestream&qt=/replication&generation=4&checksum=true&file=_0_Direct_0.pos&command=filecontent} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.475; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.476; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.476; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.479; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@285bbbe1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4998156f),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@285bbbe1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4998156f),segFN=segments_4,generation=4}
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.479; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.479; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.481; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@532ee552 main
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.482; org.apache.solr.core.SolrCore; [unloadcollection3] Registered new searcher Searcher@532ee552 main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):C3)}
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.483; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index.20130502220200396 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index.20130502220200396;done=true>>]
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.483; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index.20130502220200396
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.484; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546514901unloadcollection_3n/index.20130502220200396
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.484; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.484; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.484; org.apache.solr.cloud.ZkController; publishing core=unloadcollection3 state=active
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.485; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 02:02:00.487; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=unloadcollection3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.384; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.906; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.907; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:46013__qx",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46013/_qx",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:46013__qx_unloadcollection3",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "core":"unloadcollection3",
[junit4:junit4] 1> "shard_range":null}
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:01.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.386; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.388; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: unloadcollection
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.388; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.403; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[20 (1433976462270005248)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.403; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[20 (1433976462270005248)]} 0 2
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.404; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[20 (1433976462270005248)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.404; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[20]} 0 9
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.412; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[21 (1433976462281539584)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.414; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[21 (1433976462281539584)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.414; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[21 (1433976462281539584)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.415; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[21]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.422; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[22 (1433976462292025344)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.422; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[22 (1433976462292025344)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.423; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[22 (1433976462292025344)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.423; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[22]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.430; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[23 (1433976462300413952)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.430; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[23 (1433976462300413952)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.431; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[23 (1433976462300413952)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.432; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[23]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.447; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[24 (1433976462309851136)]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.447; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[24 (1433976462309851136)]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.448; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[24 (1433976462309851136)]} 0 12
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.449; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[24]} 0 15
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.455; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[25 (1433976462327676928)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.455; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[25 (1433976462327676928)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.456; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[25 (1433976462327676928)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.456; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[25]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.463; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[26 (1433976462335016960)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.464; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[26 (1433976462335016960)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.465; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[26 (1433976462335016960)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.466; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[26]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.472; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[27 (1433976462344454144)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.472; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[27 (1433976462344454144)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.474; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[27 (1433976462344454144)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.474; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[27]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.482; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[28 (1433976462354939904)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.482; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[28 (1433976462354939904)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.483; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[28 (1433976462354939904)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.484; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[28]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.492; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[29 (1433976462364377088)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.492; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[29 (1433976462364377088)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.493; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[29 (1433976462364377088)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.494; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[29]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.501; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[30 (1433976462374862848)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.502; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[30 (1433976462374862848)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.503; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[30 (1433976462374862848)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.504; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[30]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.512; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[31 (1433976462385348608)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.512; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[31 (1433976462385348608)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.514; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[31 (1433976462385348608)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.514; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[31]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.522; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[32 (1433976462396882944)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.522; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[32 (1433976462396882944)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.524; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[32 (1433976462396882944)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.525; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[32]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.533; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[33 (1433976462408417280)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.533; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[33 (1433976462408417280)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.534; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[33 (1433976462408417280)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.535; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[33]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.543; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[34 (1433976462418903040)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.543; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[34 (1433976462418903040)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.545; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[34 (1433976462418903040)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.546; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[34]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.554; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[35 (1433976462429388800)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.554; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[35 (1433976462429388800)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.556; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[35 (1433976462429388800)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.557; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[35]} 0 9
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.564; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[36 (1433976462440923136)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.565; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[36 (1433976462440923136)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.566; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[36 (1433976462440923136)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.567; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[36]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.575; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[37 (1433976462452457472)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.575; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[37 (1433976462452457472)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.576; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[37 (1433976462452457472)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.577; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[37]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.585; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[38 (1433976462462943232)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.585; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[38 (1433976462462943232)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.587; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[38 (1433976462462943232)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.587; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[38]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.596; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[39 (1433976462473428992)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.596; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[39 (1433976462473428992)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.597; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[39 (1433976462473428992)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.598; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[39]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.606; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[40 (1433976462484963328)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.606; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[40 (1433976462484963328)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.608; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[40 (1433976462484963328)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.609; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.617; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[41 (1433976462495449088)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.617; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[41 (1433976462495449088)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.618; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[41 (1433976462495449088)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.619; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[41]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.627; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[42 (1433976462506983424)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.627; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[42 (1433976462506983424)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.628; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[42 (1433976462506983424)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.629; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[42]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.638; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[43 (1433976462517469184)]} 0 2
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.638; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[43 (1433976462517469184)]} 0 2
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.639; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[43 (1433976462517469184)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.640; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[43]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.648; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[44 (1433976462529003520)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.648; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[44 (1433976462529003520)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.650; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[44 (1433976462529003520)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.651; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[44]} 0 9
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.659; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[45 (1433976462540537856)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.659; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[45 (1433976462540537856)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.660; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[45 (1433976462540537856)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.661; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[45]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.671; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[46 (1433976462553120768)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.671; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[46 (1433976462553120768)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.672; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[46 (1433976462553120768)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.673; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[46]} 0 9
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.681; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[47 (1433976462563606528)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.681; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[47 (1433976462563606528)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.683; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[47 (1433976462563606528)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.684; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[47]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.692; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[48 (1433976462574092288)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.692; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[48 (1433976462574092288)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.693; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[48 (1433976462574092288)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.694; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[48]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.702; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[49 (1433976462585626624)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.702; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[49 (1433976462585626624)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.704; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[49 (1433976462585626624)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.705; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[49]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.713; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[50 (1433976462596112384)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.713; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[50 (1433976462596112384)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.714; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[50 (1433976462596112384)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.715; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[50]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.723; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[51 (1433976462607646720)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.723; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[51 (1433976462607646720)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.724; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[51 (1433976462607646720)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.725; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[51]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.732; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[52 (1433976462617083904)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.733; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[52 (1433976462617083904)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.734; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[52 (1433976462617083904)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.735; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[52]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.742; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[53 (1433976462627569664)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.743; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[53 (1433976462627569664)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.744; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[53 (1433976462627569664)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.745; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.752; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[54 (1433976462638055424)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.753; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[54 (1433976462638055424)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.754; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[54 (1433976462638055424)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.755; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[54]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.763; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[55 (1433976462649589760)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.763; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[55 (1433976462649589760)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.765; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[55 (1433976462649589760)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.765; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[55]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.773; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[56 (1433976462660075520)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.774; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[56 (1433976462660075520)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.775; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[56 (1433976462660075520)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.776; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[56]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.784; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[57 (1433976462671609856)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.784; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[57 (1433976462671609856)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.786; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[57 (1433976462671609856)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.787; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[57]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.794; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[58 (1433976462682095616)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.795; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[58 (1433976462682095616)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.796; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[58 (1433976462682095616)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.797; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[58]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.805; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[59 (1433976462693629952)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.805; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[59 (1433976462693629952)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.807; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[59 (1433976462693629952)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.808; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[59]} 0 9
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.816; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[60 (1433976462705164288)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.816; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:47098/_qx/unloadcollection1/&version=2&update.distrib=FROMLEADER} {add=[60 (1433976462705164288)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.817; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection1] webapp=/_qx path=/update params={wt=javabin&distrib.from=http://127.0.0.1:46013/_qx/unloadcollection3/&version=2&update.distrib=TOLEADER} {add=[60 (1433976462705164288)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.818; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection3] webapp=/_qx path=/update params={wt=javabin&version=2} {add=[60]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 02:02:02.826; org.apache.solr.update.processor.LogUpdateProcessor; [unloadcollection2] webap
[...truncated too long message...]
tion4] CLOSING SolrCore org.apache.solr.core.SolrCore@1ce51dd1
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.360; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.360; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.361; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.361; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.364; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.365; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.366; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546524048unloadcollection_4n/index.20130502220217696 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546524048unloadcollection_4n/index.20130502220217696;done=false>>]
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.366; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546524048unloadcollection_4n/index.20130502220217696
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.367; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546524048unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546524048unloadcollection_4n;done=false>>]
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.368; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261/1367546524048unloadcollection_4n
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.368; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89623527441367052-127.0.0.1:48608__qx-n_0000000004) am no longer a leader.
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.372; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.372; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.393; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/_qx,null}
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.447; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.451; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:43998 43998
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.554; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6e90c0a4 name:ZooKeeperConnection Watcher:127.0.0.1:43998/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.554; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367546500261
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=BE612AD4C4372CAF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl_NL -Dtests.timezone=America/Toronto -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 139s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([BE612AD4C4372CAF:3F87A4CCB3684C93]:0)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 1> INFO - 2013-05-03 02:03:59.573; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4] 2> 139328 T2693 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 1> WARN - 2013-05-03 02:04:00.671; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> INFO - 2013-05-03 02:04:00.672; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> WARN - 2013-05-03 02:04:00.672; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {text=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_l=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Asserting), range_facet_si=PostingsFormat(name=Direct), intDefault=PostingsFormat(name=Asserting), id=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=Asserting), a_si=PostingsFormat(name=Direct), other_tl1=PostingsFormat(name=Asserting)}, docValues:{}, sim=DefaultSimilarity, locale=nl_NL, timezone=America/Toronto
[junit4:junit4] 2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=173813768,total=297148416
[junit4:junit4] 2> NOTE: All tests run in this JVM: [QueryResultKeyTest, SolrIndexConfigTest, XmlUpdateRequestHandlerTest, TestCSVLoader, TestRandomFaceting, SimplePostToolTest, ConvertedLegacyTest, SuggesterTSTTest, TestNumberUtils, TestHashPartitioner, TestBinaryField, TestReload, DisMaxRequestHandlerTest, PingRequestHandlerTest, ShardRoutingCustomTest, AliasIntegrationTest, CurrencyFieldXmlFileTest, TestCloudManagedSchema, BadCopyFieldTest, OpenCloseCoreStressTest, CopyFieldTest, TestJmxMonitoredMap, OpenExchangeRatesOrgProviderTest, CurrencyFieldOpenExchangeTest, TestDistributedGrouping, TestAddFieldRealTimeGet, TestFoldingMultitermQuery, CollectionsAPIDistributedZkTest, TestSolrQueryParserDefaultOperatorResource, DistanceFunctionTest, SolrRequestParserTest, HighlighterConfigTest, TimeZoneUtilsTest, TestBM25SimilarityFactory, TestFastOutputStream, TestSolrXml, TestSchemaVersionResource, TestFiltering, SolrPluginUtilsTest, TestIndexingPerformance, TestCloudManagedSchemaAddField, TestStressLucene, TestRTGBase, TestAtomicUpdateErrorCases, TermVectorComponentDistributedTest, SolrCoreCheckLockOnStartupTest, SolrCmdDistributorTest, TestPropInject, TestDistributedSearch, NumericFieldsTest, BasicDistributedZk2Test, TestPostingsSolrHighlighter, TestElisionMultitermQuery, TestManagedSchema, TestAnalyzedSuggestions, PathHierarchyTokenizerFactoryTest, SuggesterWFSTTest, TestStressReorder, ZkNodePropsTest, StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest, TestComponentsName, SpellPossibilityIteratorTest, TestQueryTypes, StatsComponentTest, DefaultValueUpdateProcessorTest, TestCodecSupport, TestSystemIdResolver, SolrTestCaseJ4Test, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 140.62s, 1 test, 1 failure <<< FAILURES!
[...truncated 484 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:384: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:364: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 295 suites, 1223 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 37 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b86) - Build #
5406 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/5406/
Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseParallelGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server refused connection at: http://127.0.0.1:50147/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:50147/collection1
at __randomizedtesting.SeedInfo.seed([D84DB669D740E53B:59AB3871A01F8507]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:429)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:145)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:490)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:50147 refused
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
... 46 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
at java.net.Socket.connect(Socket.java:581)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
... 53 more
FAILED: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard2 in collection test_unload_shard_and_collection
Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
at __randomizedtesting.SeedInfo.seed([D84DB669D740E53B:59AB3871A01F8507]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:490)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9203 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 1> INFO - 2013-05-03 03:17:52.898; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4] 1> INFO - 2013-05-03 03:17:52.903; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4] 1> INFO - 2013-05-03 03:17:52.903; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> INFO - 2013-05-03 03:17:52.904; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.004; org.apache.solr.cloud.ZkTestServer; start zk server on port:53893
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.006; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.012; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@707ba5bb name:ZooKeeperConnection Watcher:127.0.0.1:53893 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.013; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.013; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.021; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.023; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7a83cecb name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.023; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.024; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.030; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.035; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.039; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.044; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.044; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.049; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.050; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.054; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.054; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.058; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.058; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.062; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.062; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.066; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.066; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.069; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.069; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.073; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.074; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.077; org.apache.solr.cloud.AbstractZkTestCase; put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.077; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.140; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.152; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:45676
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.153; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.153; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.154; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.154; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.155; org.apache.solr.core.CoreContainer; New CoreContainer 1541446575
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.155; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/'
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.156; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/'
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.208; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.208; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.209; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.209; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.209; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.210; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.210; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.210; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.210; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.211; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.214; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.214; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53893/solr
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.214; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.215; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.218; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3bcb861 name:ZooKeeperConnection Watcher:127.0.0.1:53893 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.218; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.221; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.224; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.226; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@f2e440e name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.226; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.228; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.233; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.237; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.239; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45676_
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.240; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:45676_
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.244; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.250; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.254; org.apache.solr.cloud.Overseer; Overseer (id=89623827113902083-127.0.0.1:45676_-n_0000000000) starting
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.259; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.263; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.264; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.269; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.274; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.281; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.284; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.284; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.285; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.286; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.288; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/collection1/'
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.289; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.290; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.327; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.350; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.352; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.356; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.612; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.618; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.619; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.642; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.647; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.652; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:17:53.655; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:17:53.655; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.656; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:17:53.658; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:17:53.658; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.659; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.659; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1367551073081/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/control/data/
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.660; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@495eda4e
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.660; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.661; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/control/data
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.661; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/control/data/index/
[junit4:junit4] 1> WARN - 2013-05-03 03:17:53.662; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.670; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/control/data/index
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.677; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532325tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dae7e6b),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.677; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.680; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.680; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.681; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.682; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.682; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.683; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.683; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.684; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.684; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.689; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.694; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2291a661 main
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.694; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/control/data/tlog
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.695; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.696; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.701; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@2291a661 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.702; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-03 03:17:53.702; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:17:54.788; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:54.789; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45676",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"1",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "numShards":"1",
[junit4:junit4] 1> "node_name":"127.0.0.1:45676_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":null}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:54.790; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:54.790; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:54.796; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.704; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.705; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:45676 collection:control_collection shard:shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.707; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.722; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.727; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.727; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.728; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:45676/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.728; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.728; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:45676/collection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.729; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:45676/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:17:55.729; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.304; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.327; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.344; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:45676/collection1/ and leader is http://127.0.0.1:45676/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.345; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45676
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.345; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.345; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.345; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.348; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.351; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.352; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.352; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.358; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.360; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.363; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@780fa286 name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.363; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.367; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.373; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.445; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.448; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:50147
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.449; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.450; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.450; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.451; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.451; org.apache.solr.core.CoreContainer; New CoreContainer 1094345182
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.452; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/'
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.453; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/'
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.493; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.493; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.494; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.494; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.494; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.495; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.495; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.495; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.495; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.496; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.498; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.499; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53893/solr
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.499; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.500; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.502; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@34d81c2f name:ZooKeeperConnection Watcher:127.0.0.1:53893 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.502; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.506; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.508; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.510; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3b598a21 name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.510; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:17:56.517; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.523; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50147_
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.525; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:50147_
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.532; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.532; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.532; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.532; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.541; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.541; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.543; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.543; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.546; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/collection1/'
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.547; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.547; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.585; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.627; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.630; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.634; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.838; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.840; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45676",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"1",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "numShards":"1",
[junit4:junit4] 1> "node_name":"127.0.0.1:45676_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard1"}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.845; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.846; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.846; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.892; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.897; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.899; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.924; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.930; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.936; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:17:57.939; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:17:57.939; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.940; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:17:57.942; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:17:57.943; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.943; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.944; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1367551076373/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty1/
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.944; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@495eda4e
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.945; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.946; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.946; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty1/index/
[junit4:junit4] 1> WARN - 2013-05-03 03:17:57.946; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.947; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty1/index
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.953; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532326tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7731ab2b),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.953; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.956; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.957; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.957; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.958; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.959; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.959; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.960; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.961; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.961; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.964; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.966; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@45313258 main
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.967; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty1/tlog
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.967; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.967; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.972; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@45313258 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.974; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-03 03:17:57.974; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.353; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.354; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50147",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"2",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:50147_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":null}
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.355; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.355; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.364; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.977; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.977; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:50147 collection:collection1 shard:shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.979; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 1> INFO - 2013-05-03 03:17:59.995; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.001; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.001; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.001; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:50147/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.002; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.002; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:50147/collection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.002; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:50147/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.003; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.874; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.892; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.892; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.892; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.920; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:50147/collection1/ and leader is http://127.0.0.1:50147/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.921; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50147
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.921; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.921; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.922; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.925; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.927; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.928; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.929; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.994; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.997; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:57557
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.998; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 03:18:00.999; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.000; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.000; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.001; org.apache.solr.core.CoreContainer; New CoreContainer 617275502
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.001; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.002; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.039; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.039; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.039; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.040; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.040; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.040; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.041; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.041; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.044; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.045; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53893/solr
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.045; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.046; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.047; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5b5718b7 name:ZooKeeperConnection Watcher:127.0.0.1:53893 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.047; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.050; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.053; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.054; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5eebcea7 name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.054; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:01.059; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.064; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57557_
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.066; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:57557_
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.070; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.072; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.072; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.072; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.072; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.074; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.075; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.083; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.083; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.085; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.085; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.088; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/collection1/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.089; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.089; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.117; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.140; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.143; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.146; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.402; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.403; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50147",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"2",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:50147_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard1"}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.407; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.407; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.407; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.407; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.410; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.429; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.431; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.458; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.464; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.470; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:18:02.473; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:18:02.474; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.474; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:18:02.477; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:18:02.477; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.478; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.478; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1367551080934/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty2/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.479; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@495eda4e
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.479; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.480; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.480; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty2/index/
[junit4:junit4] 1> WARN - 2013-05-03 03:18:02.481; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.482; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty2/index
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.488; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532327tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2d45),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.488; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.491; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.491; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.492; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.493; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.494; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.494; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.495; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.496; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.497; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.502; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.506; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@43e09a2f main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.507; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty2/tlog
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.507; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.508; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.514; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@43e09a2f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.516; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-03 03:18:02.517; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.926; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.927; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57557",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"3",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:57557_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":null}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.928; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.928; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.937; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.938; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.938; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:03.938; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.519; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.520; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:57557 collection:collection1 shard:shard2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.521; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.536; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.542; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.542; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.543; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:57557/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.543; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.543; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:57557/collection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.544; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:57557/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:04.544; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.447; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.465; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.465; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.465; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.465; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.510; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:57557/collection1/ and leader is http://127.0.0.1:57557/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.511; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57557
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.511; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.512; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.512; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.515; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.517; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.518; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.518; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.582; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.584; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:57581
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.585; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.585; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.585; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.585; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.586; org.apache.solr.core.CoreContainer; New CoreContainer 1801014798
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.586; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.586; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.621; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.621; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.622; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.622; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.622; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.622; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.623; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.623; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.623; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.623; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.626; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.626; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53893/solr
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.626; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.628; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.630; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1d5b27c0 name:ZooKeeperConnection Watcher:127.0.0.1:53893 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.630; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.633; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.636; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.638; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1787306 name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.638; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:05.646; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.652; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57581_
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.654; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:57581_
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.659; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.660; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.661; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.661; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.661; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.661; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.663; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.671; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.672; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.673; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.674; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.676; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/collection1/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.678; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.678; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.714; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.739; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.740; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.744; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.977; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.978; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57557",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"3",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:57557_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard2"}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.983; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.983; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.983; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.983; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:06.983; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.018; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.023; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.025; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.049; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.055; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.061; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:18:07.063; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:18:07.064; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.064; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:18:07.066; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:18:07.067; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.067; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.068; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1367551085523/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.068; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@495eda4e
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.069; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.069; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.070; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index/
[junit4:junit4] 1> WARN - 2013-05-03 03:18:07.070; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.071; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.077; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532328tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@625382ed),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.078; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.080; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.081; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.082; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.083; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.083; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.083; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.084; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.084; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.084; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.086; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.089; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@d999e1d main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.089; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/tlog
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.089; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.089; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.094; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@d999e1d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.096; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-03 03:18:07.097; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.491; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.495; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57581",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"4",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:57581_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":null}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.495; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.495; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.504; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.505; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.505; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.505; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:08.504; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.099; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.100; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:57581 collection:collection1 shard:shard1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.107; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:57581/collection1/ and leader is http://127.0.0.1:50147/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.107; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57581
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.107; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.107; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.108; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.109; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.110; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.110; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.110; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.112; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.113; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.112; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.114; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.120; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.190; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.194; org.eclipse.jetty.server.AbstractConnector; Started SelectChannelConnector@127.0.0.1:46619
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.195; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.195; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.196; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.196; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/solr.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.197; org.apache.solr.core.CoreContainer; New CoreContainer 185488726
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.198; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.198; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.238; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.238; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.238; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.239; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.239; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.239; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.240; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.240; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.240; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.240; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.243; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.243; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53893/solr
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.244; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.244; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.246; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@57d78bfe name:ZooKeeperConnection Watcher:127.0.0.1:53893 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.246; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.249; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.254; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.256; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2ca1fd54 name:ZooKeeperConnection Watcher:127.0.0.1:53893/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.256; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-03 03:18:09.264; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.015; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.017; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"recovering",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57581",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"4",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:57581_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard1"}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.027; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.121; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.122; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={checkLive=true&state=recovering&wt=javabin&version=2&action=PREPRECOVERY&coreNodeName=4&onlyIfLeader=true&nodeName=127.0.0.1:57581_&core=collection1} status=0 QTime=1002
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.269; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46619_
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.271; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:46619_
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.276; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.276; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.277; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.277; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.278; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.277; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.277; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.278; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.278; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.279; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.280; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.280; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.289; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.289; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.291; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.291; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.294; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/collection1/'
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.295; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.295; org.apache.solr.core.SolrResourceLoader; Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.344; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.368; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.370; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.374; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.634; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.639; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.641; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.665; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.673; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.680; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:18:10.682; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:18:10.683; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.683; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 1> WARN - 2013-05-03 03:18:10.684; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4] 1> WARN - 2013-05-03 03:18:10.685; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.685; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.685; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1367551089119/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.685; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@495eda4e
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.686; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.686; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.686; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index/
[junit4:junit4] 1> WARN - 2013-05-03 03:18:10.687; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.688; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.692; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532329tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@415cc1d2),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.693; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.696; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.696; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.697; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.698; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.699; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.699; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.700; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.701; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.704; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.706; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5501d5a5 main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.706; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/tlog
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.707; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.707; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.712; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@5501d5a5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.714; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-03 03:18:10.714; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.537; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.539; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46619",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"5",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:46619_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":null}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.539; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.539; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.548; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.716; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.716; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:46619 collection:collection1 shard:shard2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.723; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:46619/collection1/ and leader is http://127.0.0.1:57557/collection1/
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.723; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46619
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.724; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.724; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.725; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.726; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.726; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.726; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.726; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.729; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.729; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.729; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.730; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.739; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.740; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.741; org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.742; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 1> INFO - 2013-05-03 03:18:11.744; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.123; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:50147/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.123; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:57581 START replicas=[http://127.0.0.1:50147/collection1/] nUpdates=100
[junit4:junit4] 1> WARN - 2013-05-03 03:18:12.124; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.124; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.124; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.125; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.125; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.125; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:50147/collection1/. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.126; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.132; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={qt=/get&wt=javabin&version=2&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.137; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.140; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532326tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7731ab2b),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.141; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.152; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532326tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7731ab2b),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532326tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7731ab2b),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.153; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.154; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@b21d0b7 realtime
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.154; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.155; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&commit_end_point=true&wt=javabin&version=2&openSearcher=false&waitSearcher=true&softCommit=false} {commit=} 0 18
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.156; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.156; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.163; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.163; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.164; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.165; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.165; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.167; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&generation=2&command=filelist} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.168; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.169; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index.20130503031812169
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.170; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@731b083 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e7b5459) fullCopy=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.172; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={qt=/replication&wt=filestream&file=segments_2&generation=2&command=filecontent&checksum=true} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.174; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.176; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.176; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.179; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532328tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@625382ed),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532328tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@625382ed),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.179; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.180; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.180; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4765ff5d main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.181; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4765ff5d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.182; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index.20130503031812169 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index.20130503031812169;done=true>>]
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.182; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index.20130503031812169
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.183; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty3/index.20130503031812169
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.183; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.183; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.184; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.184; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.187; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:12.747; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.059; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.060; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"recovering",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46619",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"5",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:46619_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard2"}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.068; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57581",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"4",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:57581_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard1"}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.076; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.741; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.742; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={checkLive=true&state=recovering&wt=javabin&version=2&action=PREPRECOVERY&coreNodeName=5&onlyIfLeader=true&nodeName=127.0.0.1:46619_&core=collection1} status=0 QTime=2002
[junit4:junit4] 1> INFO - 2013-05-03 03:18:13.750; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:14.753; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.743; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:57557/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.743; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:46619 START replicas=[http://127.0.0.1:57557/collection1/] nUpdates=100
[junit4:junit4] 1> WARN - 2013-05-03 03:18:15.744; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.744; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.745; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.745; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.745; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.745; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:57557/collection1/. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.746; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.753; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={qt=/get&wt=javabin&version=2&distrib=false&getVersions=100} status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.757; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.759; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.762; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532327tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2d45),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.763; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.782; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532327tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2d45),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532327tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2d45),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.783; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.784; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1575a81 realtime
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.784; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.785; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&commit_end_point=true&wt=javabin&version=2&openSearcher=false&waitSearcher=true&softCommit=false} {commit=} 0 26
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.786; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.786; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.789; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.789; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.790; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.790; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.790; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.793; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&generation=2&command=filelist} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.794; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.795; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index.20130503031815794
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.795; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d5f246e lockFactory=org.apache.lucene.store.NativeFSLockFactory@22f58d0e) fullCopy=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.798; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={qt=/replication&wt=filestream&file=segments_2&generation=2&command=filecontent&checksum=true} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.800; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.801; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.801; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.804; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532329tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@415cc1d2),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532329tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@415cc1d2),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.805; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.805; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.806; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@69738b9c main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.807; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@69738b9c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.807; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index.20130503031815794 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index.20130503031815794;done=true>>]
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.808; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index.20130503031815794
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.808; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1367551072903/jetty4/index.20130503031815794
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.808; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.809; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.809; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.809; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:18:15.833; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.092; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.094; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46619",
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"5",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "node_name":"127.0.0.1:46619_",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard2"}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.104; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.104; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.104; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.104; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.104; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.104; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.760; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.762; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: collection1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.771; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.774; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532325tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dae7e6b),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.775; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.782; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532325tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dae7e6b),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532325tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7dae7e6b),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.783; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.784; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1df08648 main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.784; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.785; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1df08648 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.786; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 15
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.792; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.812; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532327tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2d45),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532327tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2d45),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.813; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.813; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1cedbf6e main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.814; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.815; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1cedbf6e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.816; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:50147/collection1/, StdNode: http://127.0.0.1:57581/collection1/, StdNode: http://127.0.0.1:46619/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.820; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.828; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.828; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.832; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532326tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7731ab2b),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532326tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7731ab2b),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.833; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.833; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3cd9a96e main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.834; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.835; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3cd9a96e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.836; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&commit_end_point=true&expungeDeletes=false&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 16
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.852; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532329tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@415cc1d2),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532329tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@415cc1d2),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.853; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.852; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532328tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@625382ed),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index3232532328tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@625382ed),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.854; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.854; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@fba8b8e main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.856; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@404622f1 main
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.856; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.857; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@fba8b8e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.857; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.858; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&commit_end_point=true&expungeDeletes=false&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 31
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.857; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@404622f1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.859; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&commit_end_point=true&expungeDeletes=false&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 32
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.860; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 68
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.862; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.866; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&version=2&rows=0&tests=checkShardConsistency&q=*:*&distrib=false} hits=0 status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.869; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&version=2&rows=0&tests=checkShardConsistency&q=*:*&distrib=false} hits=0 status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.871; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&version=2&rows=0&tests=checkShardConsistency&q=*:*&distrib=false} hits=0 status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:16.874; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={wt=javabin&version=2&rows=0&tests=checkShardConsistency&q=*:*&distrib=false} hits=0 status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.879; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1433981261056049152)} 0 2
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.886; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.from=http://127.0.0.1:57557/collection1/&version=2&_version_=-1433981261061292032&update.distrib=FROMLEADER} {deleteByQuery=*:* (-1433981261061292032)} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.890; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&update.from=http://127.0.0.1:50147/collection1/&version=2&_version_=-1433981261064437760&update.distrib=FROMLEADER} {deleteByQuery=*:* (-1433981261064437760)} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.891; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2&update.distrib=TOLEADER} {deleteByQuery=*:* (-1433981261064437760)} 0 6
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.892; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1433981261061292032)} 0 11
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.898; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1433981261074923520)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.908; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[0 (1433981261080166400)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.909; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1433981261080166400)]} 0 9
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.912; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1433981261092749312)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.921; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[1 (1433981261097992192)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.922; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[1 (1433981261097992192)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.923; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.926; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1433981261107429376)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.936; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[2 (1433981261110575104)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.937; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1433981261110575104)]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.940; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1433981261122109440)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.947; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[3 (1433981261125255168)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.948; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1433981261125255168)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.951; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1433981261133643776)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.958; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[4 (1433981261136789504)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.959; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1433981261136789504)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.962; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1433981261144129536)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.968; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[5 (1433981261148323840)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.969; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1433981261148323840)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.972; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1433981261155663872)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.980; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[6 (1433981261160906752)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.981; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[6 (1433981261160906752)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.982; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.985; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1433981261169295360)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.994; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[7 (1433981261175586816)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.995; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[7 (1433981261175586816)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.996; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 03:18:18.999; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1433981261182926848)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.006; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[8 (1433981261189218304)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.007; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[8 (1433981261189218304)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.008; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.011; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1433981261196558336)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.017; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[9 (1433981261199704064)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.018; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1433981261199704064)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.021; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1433981261207044096)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.026; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[10 (1433981261209141248)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.027; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1433981261209141248)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.030; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1433981261216481280)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.036; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[11 (1433981261219627008)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.037; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1433981261219627008)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.040; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1433981261226967040)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.046; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[12 (1433981261230112768)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.047; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1433981261230112768)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.050; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1433981261237452800)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.056; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[13 (1433981261240598528)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.057; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1433981261240598528)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.060; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1433981261247938560)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.068; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[14 (1433981261253181440)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.069; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[14 (1433981261253181440)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.070; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.073; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1433981261261570048)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.082; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[15 (1433981261266812928)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.083; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[15 (1433981261266812928)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.083; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.087; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1433981261275201536)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.093; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[16 (1433981261279395840)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.094; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1433981261279395840)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.097; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1433981261286735872)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.105; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[17 (1433981261291978752)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.106; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[17 (1433981261291978752)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.107; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.111; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1433981261300367360)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.119; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[18 (1433981261306658816)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.120; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[18 (1433981261306658816)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.121; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.124; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1433981261315047424)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.132; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[19 (1433981261320290304)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.133; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[19 (1433981261320290304)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.134; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.137; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1433981261328678912)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.146; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[20 (1433981261333921792)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.147; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[20 (1433981261333921792)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.147; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20]} 0 7
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.151; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1433981261342310400)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.157; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[21 (1433981261346504704)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.158; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1433981261346504704)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.161; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1433981261353844736)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.167; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[22 (1433981261356990464)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.168; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1433981261356990464)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.171; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1433981261364330496)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.177; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[23 (1433981261367476224)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.178; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1433981261367476224)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.182; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1433981261374816256)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.190; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[24 (1433981261381107712)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.191; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[24 (1433981261381107712)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.192; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.195; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1433981261388447744)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.203; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57557/collection1/&wt=javabin&version=2&update.distrib=FROMLEADER} {add=[25 (1433981261394739200)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.204; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50147/collection1/&wt=javabin&version=2&update.distrib=TOLEADER} {add=[25 (1433981261394739200)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-03 03:18:19.205; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp
[...truncated too long message...]
> INFO - 2013-05-03 03:25:58.718; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.235; org.apache.solr.cloud.ZkController; publishing core=unloadcollection4 state=down
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.236; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.238; org.apache.solr.core.SolrCore; [unloadcollection4] CLOSING SolrCore org.apache.solr.core.SolrCore@6d781158
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.248; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.249; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.249; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.250; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.252; org.apache.solr.core.SolrCore; [unloadcollection4] Closing main searcher on request.
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.253; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.253; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153/1367551444363unloadcollection_4n/index.20130503052417896 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153/1367551444363unloadcollection_4n/index.20130503052417896;done=false>>]
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.254; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153/1367551444363unloadcollection_4n/index.20130503052417896
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.255; org.apache.solr.core.CachingDirectoryFactory; looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153/1367551444363unloadcollection_4n [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153/1367551444363unloadcollection_4n;done=false>>]
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.255; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153/1367551444363unloadcollection_4n
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.257; org.apache.solr.cloud.Overseer$ClusterStateUpdater; According to ZK I (id=89623850002350092-127.0.0.1:57015_-n_0000000004) am no longer a leader.
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.258; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> WARN - 2013-05-03 03:26:00.259; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.259; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (0)
[junit4:junit4] 1> WARN - 2013-05-03 03:26:00.260; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.281; org.eclipse.jetty.server.handler.ContextHandler; stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.334; org.apache.solr.SolrTestCaseJ4; ###Ending testDistribSearch
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.338; org.apache.solr.cloud.ZkTestServer; connecting to 127.0.0.1:33626 33626
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.441; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2b4ad847 name:ZooKeeperConnection Watcher:127.0.0.1:33626/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.442; org.apache.solr.common.cloud.ConnectionManager; Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1367551422153
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=D84DB669D740E53B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PR -Dtests.timezone=Europe/Stockholm -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 138s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([D84DB669D740E53B:59AB3871A01F8507]:0)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 1> INFO - 2013-05-03 03:26:00.469; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4] 2> 138329 T2305 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=es_PR, timezone=Europe/Stockholm
[junit4:junit4] 2> NOTE: Linux 3.2.0-40-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=172202840,total=342491136
[junit4:junit4] 2> NOTE: All tests run in this JVM: [BasicZkTest, FileUtilsTest, OpenExchangeRatesOrgProviderTest, TestReload, RequestHandlersTest, CoreContainerCoreInitFailuresTest, TestFastOutputStream, TestSolr4Spatial, TestSuggestSpellingConverter, TestJmxMonitoredMap, TestCollationField, IndexReaderFactoryTest, ChaosMonkeySafeLeaderTest, DebugComponentTest, TestZkChroot, TestIndexingPerformance, TestStressLucene, JSONWriterTest, TestFieldCollectionResource, PreAnalyzedUpdateProcessorTest, FullSolrCloudDistribCmdsTest, SortByFunctionTest, TestManagedSchema, FieldAnalysisRequestHandlerTest, TestFiltering, TestArbitraryIndexDir, CachingDirectoryFactoryTest, TestHashPartitioner, TestQueryTypes, TestRTGBase, BasicDistributedZk2Test, IndexBasedSpellCheckerTest, SpellPossibilityIteratorTest, RequiredFieldsTest, XsltUpdateRequestHandlerTest, TestCoreDiscovery, ClusterStateTest, LeaderElectionIntegrationTest, TestUpdate, SpellCheckComponentTest, TestUtils, HardAutoCommitTest, TestRangeQuery, TestShardHandlerFactory, UniqFieldsUpdateProcessorFactoryTest, TestFieldTypeCollectionResource, TestSolrJ, ConvertedLegacyTest, TestBM25SimilarityFactory, CollectionsAPIDistributedZkTest, TestRandomFaceting, TestLuceneMatchVersion, TestDistributedSearch, TestBinaryField, SuggesterWFSTTest, TimeZoneUtilsTest, TestQuerySenderNoQuery, SignatureUpdateProcessorFactoryTest, TestFoldingMultitermQuery, TestAtomicUpdateErrorCases, CopyFieldTest, TestCSVResponseWriter, TestComponentsName, TestSerializedLuceneMatchVersion, TestSystemIdResolver, SolrCoreCheckLockOnStartupTest, TermVectorComponentDistributedTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 139.10s, 1 test, 1 failure <<< FAILURES!
[...truncated 456 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:384: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:364: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:887: There were test failures: 295 suites, 1223 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 35 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b86 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure