You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/19 13:07:25 UTC

[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.6.0_45) - Build # 6136 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6136/
Java: 64bit/jdk1.6.0_45 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:49256/collection1lastClient and got 257 from http://127.0.0.1:50814/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:49256/collection1lastClient and got 257 from http://127.0.0.1:50814/collection1
	at __randomizedtesting.SeedInfo.seed([3E86E17B11382676:BF606F636667464A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8783 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 285625 T1749 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 285631 T1749 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371638980188
[junit4:junit4]   2> 285632 T1749 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 285633 T1750 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 285733 T1749 oasc.ZkTestServer.run start zk server on port:59283
[junit4:junit4]   2> 285734 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 285738 T1756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3867011a name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 285738 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 285738 T1749 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 285740 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 285741 T1758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fb8be24 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 285742 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 285742 T1749 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 285743 T1749 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 285745 T1749 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 285746 T1749 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 285747 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 285748 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 285750 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 285750 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 285752 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 285753 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 285755 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 285756 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 285757 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 285758 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 285759 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 285760 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 285762 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 285762 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 285765 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 285766 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 285767 T1749 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 285768 T1749 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 285839 T1749 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 285841 T1749 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38132
[junit4:junit4]   2> 285842 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 285842 T1749 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 285842 T1749 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325
[junit4:junit4]   2> 285843 T1749 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/solr.xml
[junit4:junit4]   2> 285843 T1749 oasc.CoreContainer.<init> New CoreContainer 838983853
[junit4:junit4]   2> 285843 T1749 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/'
[junit4:junit4]   2> 285844 T1749 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/'
[junit4:junit4]   2> 285887 T1749 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 285888 T1749 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 285888 T1749 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 285888 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 285889 T1749 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 285889 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 285889 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 285890 T1749 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 285890 T1749 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 285890 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 285894 T1749 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 285894 T1749 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
[junit4:junit4]   2> 285895 T1749 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 285895 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 285897 T1769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47ffd95d name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 285898 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 285899 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 285902 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 285903 T1771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@130da6ae name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 285903 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 285904 T1749 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 285906 T1749 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 285908 T1749 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 285909 T1749 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38132_
[junit4:junit4]   2> 285910 T1749 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38132_
[junit4:junit4]   2> 285911 T1749 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 285915 T1749 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 285916 T1749 oasc.Overseer.start Overseer (id=89891732205797379-127.0.0.1:38132_-n_0000000000) starting
[junit4:junit4]   2> 285918 T1749 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 285920 T1773 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 285920 T1749 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 285922 T1749 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 285923 T1749 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 285924 T1772 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 285926 T1774 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 285926 T1774 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 287427 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 287427 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38132_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38132"}
[junit4:junit4]   2> 287428 T1772 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 287428 T1772 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 287430 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 287928 T1774 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/collection1
[junit4:junit4]   2> 287928 T1774 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 287928 T1774 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 287929 T1774 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 287930 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/collection1/'
[junit4:junit4]   2> 287930 T1774 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/collection1/lib/README' to classloader
[junit4:junit4]   2> 287930 T1774 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 287959 T1774 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 287989 T1774 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 287991 T1774 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 287995 T1774 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 288349 T1774 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 288356 T1774 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 288358 T1774 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 288370 T1774 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 288373 T1774 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 288375 T1774 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 288376 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 288376 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 288376 T1774 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 288377 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 288377 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 288377 T1774 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 288378 T1774 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371638980325/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/
[junit4:junit4]   2> 288378 T1774 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26a7dd39
[junit4:junit4]   2> 288378 T1774 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 288379 T1774 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data
[junit4:junit4]   2> 288379 T1774 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index/
[junit4:junit4]   2> 288379 T1774 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 288380 T1774 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index
[junit4:junit4]   2> 288383 T1774 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 288383 T1774 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 288385 T1774 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 288385 T1774 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 288385 T1774 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 288386 T1774 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 288386 T1774 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 288386 T1774 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 288386 T1774 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 288387 T1774 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 288387 T1774 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 288389 T1774 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 288392 T1774 oass.SolrIndexSearcher.<init> Opening Searcher@5791461b main
[junit4:junit4]   2> 288392 T1774 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 288392 T1774 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 288396 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5791461b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 288397 T1774 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 288397 T1774 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38132 collection:control_collection shard:shard1
[junit4:junit4]   2> 288397 T1774 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 288402 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 288404 T1774 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 288404 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 288404 T1774 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38132/collection1/
[junit4:junit4]   2> 288404 T1774 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 288405 T1774 oasc.SyncStrategy.syncToMe http://127.0.0.1:38132/collection1/ has no replicas
[junit4:junit4]   2> 288405 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38132/collection1/
[junit4:junit4]   2> 288405 T1774 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 288933 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 288938 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 288961 T1774 oasc.ZkController.register We are http://127.0.0.1:38132/collection1/ and leader is http://127.0.0.1:38132/collection1/
[junit4:junit4]   2> 288961 T1774 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38132
[junit4:junit4]   2> 288961 T1774 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 288961 T1774 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 288961 T1774 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 288963 T1774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 288964 T1749 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 288964 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 288964 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 288968 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 288970 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 288971 T1778 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63efc65f name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 288972 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 288972 T1749 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 288975 T1749 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 289046 T1749 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 289048 T1749 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49256
[junit4:junit4]   2> 289048 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 289049 T1749 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 289049 T1749 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531
[junit4:junit4]   2> 289049 T1749 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/solr.xml
[junit4:junit4]   2> 289050 T1749 oasc.CoreContainer.<init> New CoreContainer 360285872
[junit4:junit4]   2> 289050 T1749 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/'
[junit4:junit4]   2> 289050 T1749 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/'
[junit4:junit4]   2> 289098 T1749 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 289098 T1749 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 289098 T1749 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 289099 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 289099 T1749 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 289099 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 289100 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 289100 T1749 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 289100 T1749 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 289100 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 289104 T1749 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 289104 T1749 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
[junit4:junit4]   2> 289105 T1749 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 289105 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 289107 T1789 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e53e636 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 289107 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 289108 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 289111 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 289112 T1791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad1f319 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 289113 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 289115 T1749 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 290117 T1749 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49256_
[junit4:junit4]   2> 290118 T1749 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49256_
[junit4:junit4]   2> 290120 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 290120 T1778 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 290120 T1791 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 290121 T1771 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 290124 T1792 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 290124 T1792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 290441 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 290441 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:38132__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38132_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38132"}
[junit4:junit4]   2> 290443 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49256_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49256"}
[junit4:junit4]   2> 290443 T1772 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 290443 T1772 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 290446 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 290446 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 290446 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 291125 T1792 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/collection1
[junit4:junit4]   2> 291126 T1792 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 291126 T1792 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 291126 T1792 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 291127 T1792 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/collection1/'
[junit4:junit4]   2> 291127 T1792 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/collection1/lib/README' to classloader
[junit4:junit4]   2> 291128 T1792 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 291152 T1792 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 291187 T1792 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 291188 T1792 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 291193 T1792 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 291547 T1792 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 291553 T1792 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 291556 T1792 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 291566 T1792 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 291569 T1792 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 291572 T1792 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 291572 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 291572 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 291573 T1792 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 291573 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 291573 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 291574 T1792 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 291574 T1792 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371638983531/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/
[junit4:junit4]   2> 291574 T1792 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26a7dd39
[junit4:junit4]   2> 291574 T1792 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 291575 T1792 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1
[junit4:junit4]   2> 291575 T1792 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index/
[junit4:junit4]   2> 291575 T1792 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 291576 T1792 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index
[junit4:junit4]   2> 291578 T1792 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 291579 T1792 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 291581 T1792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 291581 T1792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 291581 T1792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 291582 T1792 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 291582 T1792 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 291583 T1792 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 291583 T1792 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 291583 T1792 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 291584 T1792 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 291586 T1792 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 291588 T1792 oass.SolrIndexSearcher.<init> Opening Searcher@13b2d1de main
[junit4:junit4]   2> 291589 T1792 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 291589 T1792 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 291594 T1793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13b2d1de main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 291596 T1792 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 291596 T1792 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49256 collection:collection1 shard:shard1
[junit4:junit4]   2> 291596 T1792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 291600 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 291602 T1792 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 291602 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 291602 T1792 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 291603 T1792 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 291603 T1792 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/ has no replicas
[junit4:junit4]   2> 291603 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 291603 T1792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 291950 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 291956 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 291956 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 291956 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 292007 T1792 oasc.ZkController.register We are http://127.0.0.1:49256/collection1/ and leader is http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 292007 T1792 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49256
[junit4:junit4]   2> 292007 T1792 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 292008 T1792 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 292008 T1792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 292010 T1792 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 292011 T1749 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 292012 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 292013 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 292107 T1749 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 292109 T1749 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51672
[junit4:junit4]   2> 292110 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 292110 T1749 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 292111 T1749 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573
[junit4:junit4]   2> 292111 T1749 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/solr.xml
[junit4:junit4]   2> 292111 T1749 oasc.CoreContainer.<init> New CoreContainer 2077954664
[junit4:junit4]   2> 292112 T1749 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/'
[junit4:junit4]   2> 292112 T1749 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/'
[junit4:junit4]   2> 292165 T1749 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 292166 T1749 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 292166 T1749 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 292167 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 292167 T1749 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 292168 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 292168 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 292168 T1749 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 292169 T1749 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 292169 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 292173 T1749 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 292174 T1749 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
[junit4:junit4]   2> 292175 T1749 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 292175 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 292177 T1805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56e8dd63 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 292177 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 292178 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 292182 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 292183 T1807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2199b0d3 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 292183 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 292186 T1749 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 293188 T1749 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51672_
[junit4:junit4]   2> 293189 T1749 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51672_
[junit4:junit4]   2> 293190 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 293190 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 293191 T1807 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 293191 T1791 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 293191 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 293192 T1778 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 293192 T1771 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 293195 T1808 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 293195 T1808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 293461 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 293462 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:49256__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49256_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49256"}
[junit4:junit4]   2> 293465 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51672_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51672"}
[junit4:junit4]   2> 293465 T1772 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 293465 T1772 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 293468 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 293468 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 293468 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 293468 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 294196 T1808 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/collection1
[junit4:junit4]   2> 294196 T1808 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 294197 T1808 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 294197 T1808 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 294198 T1808 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/collection1/'
[junit4:junit4]   2> 294198 T1808 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/collection1/lib/README' to classloader
[junit4:junit4]   2> 294199 T1808 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 294223 T1808 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 294259 T1808 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 294260 T1808 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 294265 T1808 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 294628 T1808 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 294634 T1808 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 294637 T1808 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 294652 T1808 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 294656 T1808 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 294661 T1808 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 294662 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 294662 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 294662 T1808 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 294663 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 294663 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 294664 T1808 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 294664 T1808 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371638986573/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/
[junit4:junit4]   2> 294664 T1808 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26a7dd39
[junit4:junit4]   2> 294665 T1808 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 294665 T1808 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2
[junit4:junit4]   2> 294666 T1808 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index/
[junit4:junit4]   2> 294666 T1808 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 294666 T1808 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index
[junit4:junit4]   2> 294670 T1808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 294671 T1808 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 294673 T1808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 294673 T1808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 294673 T1808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 294674 T1808 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 294674 T1808 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 294674 T1808 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 294675 T1808 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 294675 T1808 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 294675 T1808 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 294677 T1808 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 294680 T1808 oass.SolrIndexSearcher.<init> Opening Searcher@2a4dd05f main
[junit4:junit4]   2> 294681 T1808 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 294682 T1808 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 294687 T1809 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a4dd05f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 294689 T1808 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 294689 T1808 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51672 collection:collection1 shard:shard1
[junit4:junit4]   2> 294691 T1808 oasc.ZkController.register We are http://127.0.0.1:51672/collection1/ and leader is http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 294692 T1808 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51672
[junit4:junit4]   2> 294692 T1808 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 294692 T1808 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 294695 T1808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C2405 name=collection1 org.apache.solr.core.SolrCore@237b68d0 url=http://127.0.0.1:51672/collection1 node=127.0.0.1:51672_ C2405_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51672_, base_url=http://127.0.0.1:51672}
[junit4:junit4]   2> 294695 T1810 C2405 P51672 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 294696 T1749 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 294696 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 294697 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 294699 T1810 C2405 P51672 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 294699 T1810 C2405 P51672 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 294699 T1810 C2405 P51672 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 294705 T1810 C2405 P51672 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 294712 T1785 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:51672__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 294769 T1749 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 294771 T1749 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50814
[junit4:junit4]   2> 294772 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 294772 T1749 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 294772 T1749 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256
[junit4:junit4]   2> 294773 T1749 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/solr.xml
[junit4:junit4]   2> 294773 T1749 oasc.CoreContainer.<init> New CoreContainer 1530075314
[junit4:junit4]   2> 294773 T1749 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/'
[junit4:junit4]   2> 294774 T1749 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/'
[junit4:junit4]   2> 294823 T1749 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 294823 T1749 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 294824 T1749 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 294824 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 294824 T1749 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 294824 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 294825 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 294825 T1749 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 294825 T1749 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 294826 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 294829 T1749 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 294829 T1749 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
[junit4:junit4]   2> 294830 T1749 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 294830 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 294832 T1822 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20079308 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 294832 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 294834 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 294837 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 294838 T1824 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c53e416 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 294838 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 294841 T1749 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 294973 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 294974 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:51672__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51672_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51672"}
[junit4:junit4]   2> 294977 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 294977 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 294977 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 294977 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 294978 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 295713 T1785 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:51672__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 295713 T1785 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:51672__collection1&state=recovering&nodeName=127.0.0.1:51672_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 295843 T1749 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50814_
[junit4:junit4]   2> 295845 T1749 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50814_
[junit4:junit4]   2> 295847 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 295847 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 295847 T1824 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 295848 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 295847 T1791 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 295847 T1807 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 295848 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 295848 T1771 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 295848 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 295848 T1778 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 295852 T1825 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 295852 T1825 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 296481 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 296482 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50814_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50814"}
[junit4:junit4]   2> 296482 T1772 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 296482 T1772 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 296486 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 296486 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 296486 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 296486 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 296486 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 296853 T1825 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/collection1
[junit4:junit4]   2> 296853 T1825 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 296854 T1825 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 296854 T1825 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 296856 T1825 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/collection1/'
[junit4:junit4]   2> 296856 T1825 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/collection1/lib/README' to classloader
[junit4:junit4]   2> 296857 T1825 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 296889 T1825 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 296935 T1825 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 296936 T1825 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 296941 T1825 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 297347 T1825 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 297354 T1825 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 297357 T1825 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 297367 T1825 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 297369 T1825 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 297372 T1825 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 297372 T1825 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 297373 T1825 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 297373 T1825 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 297373 T1825 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 297374 T1825 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 297374 T1825 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 297374 T1825 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371638989256/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/
[junit4:junit4]   2> 297374 T1825 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26a7dd39
[junit4:junit4]   2> 297375 T1825 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 297375 T1825 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3
[junit4:junit4]   2> 297375 T1825 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index/
[junit4:junit4]   2> 297376 T1825 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 297376 T1825 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index
[junit4:junit4]   2> 297378 T1825 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 297379 T1825 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 297381 T1825 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 297381 T1825 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 297381 T1825 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 297382 T1825 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 297382 T1825 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 297382 T1825 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 297383 T1825 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 297383 T1825 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 297383 T1825 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 297385 T1825 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 297388 T1825 oass.SolrIndexSearcher.<init> Opening Searcher@27b0cba3 main
[junit4:junit4]   2> 297388 T1825 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 297389 T1825 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 297393 T1826 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27b0cba3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 297395 T1825 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 297395 T1825 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50814 collection:collection1 shard:shard1
[junit4:junit4]   2> 297398 T1825 oasc.ZkController.register We are http://127.0.0.1:50814/collection1/ and leader is http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 297398 T1825 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50814
[junit4:junit4]   2> 297398 T1825 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 297398 T1825 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2406 name=collection1 org.apache.solr.core.SolrCore@29ab13e3 url=http://127.0.0.1:50814/collection1 node=127.0.0.1:50814_ C2406_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:50814_, base_url=http://127.0.0.1:50814}
[junit4:junit4]   2> 297399 T1827 C2406 P50814 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 297399 T1825 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 297400 T1827 C2406 P50814 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 297400 T1827 C2406 P50814 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 297400 T1827 C2406 P50814 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 297400 T1749 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 297404 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> ASYNC  NEW_CORE C2407 name=collection1 org.apache.solr.core.SolrCore@29ab13e3 url=http://127.0.0.1:50814/collection1 node=127.0.0.1:50814_ C2407_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:50814_, base_url=http://127.0.0.1:50814}
[junit4:junit4]   2> 297404 T1827 C2407 P50814 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 297405 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 297410 T1785 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:50814__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 297500 T1749 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 297502 T1749 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48418
[junit4:junit4]   2> 297503 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 297503 T1749 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 297503 T1749 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965
[junit4:junit4]   2> 297504 T1749 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/solr.xml
[junit4:junit4]   2> 297504 T1749 oasc.CoreContainer.<init> New CoreContainer 1235381104
[junit4:junit4]   2> 297504 T1749 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/'
[junit4:junit4]   2> 297505 T1749 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/'
[junit4:junit4]   2> 297549 T1749 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 297550 T1749 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 297550 T1749 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 297551 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 297551 T1749 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 297551 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 297551 T1749 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 297552 T1749 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 297552 T1749 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 297552 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 297556 T1749 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 297556 T1749 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
[junit4:junit4]   2> 297557 T1749 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 297557 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 297559 T1839 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@778e0f51 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 297560 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 297561 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 297564 T1749 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 297565 T1841 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70177753 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 297565 T1749 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 297567 T1749 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C2408 name=collection1 org.apache.solr.core.SolrCore@237b68d0 url=http://127.0.0.1:51672/collection1 node=127.0.0.1:51672_ C2408_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51672_, base_url=http://127.0.0.1:51672}
[junit4:junit4]   2> 297714 T1810 C2408 P51672 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49256/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 297717 T1810 C2408 P51672 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 297721 T1810 C2408 P51672 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51672 START replicas=[http://127.0.0.1:49256/collection1/] nUpdates=100
[junit4:junit4]   2> 297721 T1810 C2408 P51672 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 297722 T1810 C2408 P51672 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 297722 T1810 C2408 P51672 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 297722 T1810 C2408 P51672 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 297723 T1810 C2408 P51672 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 297723 T1810 C2408 P51672 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49256/collection1/. core=collection1
[junit4:junit4]   2> 297723 T1810 C2408 P51672 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C2409 name=collection1 org.apache.solr.core.SolrCore@647c5f84 url=http://127.0.0.1:49256/collection1 node=127.0.0.1:49256_ C2409_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49256_, base_url=http://127.0.0.1:49256, leader=true}
[junit4:junit4]   2> 297729 T1787 C2409 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 297736 T1786 C2409 P49256 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 297738 T1786 C2409 P49256 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> ASYNC  NEW_CORE C2410 name=collection1 org.apache.solr.core.SolrCore@647c5f84 url=http://127.0.0.1:49256/collection1 node=127.0.0.1:49256_ C2410_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49256_, base_url=http://127.0.0.1:49256, leader=true}
[junit4:junit4]   2> 297746 T1786 C2410 P49256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 297754 T1786 C2410 P49256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 297755 T1786 C2410 P49256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 297756 T1786 C2410 P49256 oass.SolrIndexSearcher.<init> Opening Searcher@5ed3d6cd realtime
[junit4:junit4]   2> 297756 T1786 C2410 P49256 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 297756 T1786 C2410 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4]   2> ASYNC  NEW_CORE C2411 name=collection1 org.apache.solr.core.SolrCore@237b68d0 url=http://127.0.0.1:51672/collection1 node=127.0.0.1:51672_ C2411_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51672_, base_url=http://127.0.0.1:51672}
[junit4:junit4]   2> 297757 T1810 C2411 P51672 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 297757 T1810 C2411 P51672 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 297759 T1787 C2410 P49256 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 297759 T1787 C2410 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 297760 T1810 C2411 P51672 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 297760 T1810 C2411 P51672 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 297760 T1810 C2411 P51672 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 297762 T1786 C2410 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   2> 297762 T1810 C2411 P51672 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 297763 T1810 C2411 P51672 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index.20130619074952318
[junit4:junit4]   2> 297763 T1810 C2411 P51672 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index.20130619074952318 lockFactory=org.apache.lucene.store.NativeFSLockFactory@140943f7; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 297766 T1784 C2410 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 297767 T1810 C2411 P51672 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 297775 T1810 C2411 P51672 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 297775 T1810 C2411 P51672 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 297777 T1810 C2411 P51672 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 297777 T1810 C2411 P51672 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 297778 T1810 C2411 P51672 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 297778 T1810 C2411 P51672 oass.SolrIndexSearcher.<init> Opening Searcher@19cf9706 main
[junit4:junit4]   2> 297779 T1809 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19cf9706 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 297780 T1810 C2411 P51672 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index.20130619074952318 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index.20130619074952318;done=true>>]
[junit4:junit4]   2> 297780 T1810 C2411 P51672 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index.20130619074952318
[junit4:junit4]   2> 297780 T1810 C2411 P51672 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index.20130619074952318
[junit4:junit4]   2> 297781 T1810 C2411 P51672 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 297781 T1810 C2411 P51672 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 297781 T1810 C2411 P51672 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 297781 T1810 C2411 P51672 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 297783 T1810 C2411 P51672 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 297990 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 297991 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:50814__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50814_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50814"}
[junit4:junit4]   2> 297994 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:51672__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51672_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51672"}
[junit4:junit4]   2> 298014 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298015 T1841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298015 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298015 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298014 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298014 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298411 T1785 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:50814__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 298411 T1785 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:50814__collection1&state=recovering&nodeName=127.0.0.1:50814_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 298569 T1749 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48418_
[junit4:junit4]   2> 298570 T1749 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48418_
[junit4:junit4]   2> 298572 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298572 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 298573 T1807 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 298573 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 298573 T1791 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 298573 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 298573 T1824 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 298574 T1841 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 298574 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 298575 T1771 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 298574 T1778 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 298574 T1841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 298579 T1844 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 298579 T1844 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 299521 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 299522 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48418_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48418"}
[junit4:junit4]   2> 299522 T1772 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 299522 T1772 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 299525 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 299525 T1841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 299525 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 299525 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 299525 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 299525 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 299580 T1844 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/collection1
[junit4:junit4]   2> 299581 T1844 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 299581 T1844 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 299581 T1844 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 299583 T1844 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/collection1/'
[junit4:junit4]   2> 299583 T1844 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/collection1/lib/README' to classloader
[junit4:junit4]   2> 299583 T1844 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 299610 T1844 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 299654 T1844 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 299655 T1844 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 299660 T1844 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 300018 T1844 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 300025 T1844 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 300027 T1844 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 300038 T1844 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 300040 T1844 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 300043 T1844 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 300044 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 300044 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 300044 T1844 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 300045 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 300045 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 300045 T1844 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 300045 T1844 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371638991965/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/
[junit4:junit4]   2> 300046 T1844 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26a7dd39
[junit4:junit4]   2> 300046 T1844 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 300047 T1844 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4
[junit4:junit4]   2> 300047 T1844 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index/
[junit4:junit4]   2> 300047 T1844 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 300048 T1844 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index
[junit4:junit4]   2> 300050 T1844 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 300051 T1844 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 300052 T1844 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 300053 T1844 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 300053 T1844 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 300054 T1844 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 300054 T1844 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 300054 T1844 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 300055 T1844 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 300055 T1844 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 300056 T1844 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 300057 T1844 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 300060 T1844 oass.SolrIndexSearcher.<init> Opening Searcher@15dce958 main
[junit4:junit4]   2> 300061 T1844 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 300061 T1844 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 300069 T1845 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15dce958 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 300071 T1844 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 300072 T1844 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48418 collection:collection1 shard:shard1
[junit4:junit4]   2> 300074 T1844 oasc.ZkController.register We are http://127.0.0.1:48418/collection1/ and leader is http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 300074 T1844 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48418
[junit4:junit4]   2> 300074 T1844 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 300075 T1844 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2412 name=collection1 org.apache.solr.core.SolrCore@6260a433 url=http://127.0.0.1:48418/collection1 node=127.0.0.1:48418_ C2412_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48418_, base_url=http://127.0.0.1:48418}
[junit4:junit4]   2> 300075 T1846 C2412 P48418 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 300076 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 300076 T1844 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 300076 T1846 C2412 P48418 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 300076 T1846 C2412 P48418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 300077 T1749 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 300077 T1749 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 300077 T1846 C2412 P48418 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 300078 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 300082 T1786 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:48418__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 300082 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 300084 T1749 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 300084 T1749 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 300085 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C2413 name=collection1 org.apache.solr.core.SolrCore@29ab13e3 url=http://127.0.0.1:50814/collection1 node=127.0.0.1:50814_ C2413_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50814_, base_url=http://127.0.0.1:50814}
[junit4:junit4]   2> 300412 T1827 C2413 P50814 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49256/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 300412 T1827 C2413 P50814 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50814 START replicas=[http://127.0.0.1:49256/collection1/] nUpdates=100
[junit4:junit4]   2> 300413 T1827 C2413 P50814 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 300413 T1827 C2413 P50814 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 300414 T1827 C2413 P50814 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 300414 T1827 C2413 P50814 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 300414 T1827 C2413 P50814 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 300414 T1827 C2413 P50814 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49256/collection1/. core=collection1
[junit4:junit4]   2> 300415 T1827 C2413 P50814 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C2414 name=collection1 org.apache.solr.core.SolrCore@647c5f84 url=http://127.0.0.1:49256/collection1 node=127.0.0.1:49256_ C2414_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49256_, base_url=http://127.0.0.1:49256, leader=true}
[junit4:junit4]   2> 300416 T1784 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 300419 T1787 C2414 P49256 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 300604 T1787 C2414 P49256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 300605 T1787 C2414 P49256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 300605 T1787 C2414 P49256 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 300606 T1787 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 187
[junit4:junit4]   2> 300606 T1827 C2413 P50814 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 300607 T1827 C2413 P50814 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 300609 T1787 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 300610 T1827 C2413 P50814 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 300610 T1827 C2413 P50814 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 300610 T1827 C2413 P50814 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 300612 T1784 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0 
[junit4:junit4]   2> 300613 T1827 C2413 P50814 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 300614 T1827 C2413 P50814 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index.20130619074955169
[junit4:junit4]   2> 300614 T1827 C2413 P50814 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index.20130619074955169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@50be7f47; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 300618 T1785 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   2> 300619 T1827 C2413 P50814 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 300622 T1827 C2413 P50814 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 300622 T1827 C2413 P50814 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 300625 T1827 C2413 P50814 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 300625 T1827 C2413 P50814 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 300626 T1827 C2413 P50814 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 300626 T1827 C2413 P50814 oass.SolrIndexSearcher.<init> Opening Searcher@193df579 main
[junit4:junit4]   2> 300628 T1826 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@193df579 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 300628 T1827 C2413 P50814 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index.20130619074955169 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index.20130619074955169;done=true>>]
[junit4:junit4]   2> 300629 T1827 C2413 P50814 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index.20130619074955169
[junit4:junit4]   2> 300629 T1827 C2413 P50814 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index.20130619074955169
[junit4:junit4]   2> 300629 T1827 C2413 P50814 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 300630 T1827 C2413 P50814 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 300630 T1827 C2413 P50814 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 300630 T1827 C2413 P50814 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 300631 T1827 C2413 P50814 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 301029 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 301030 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:48418__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48418_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48418"}
[junit4:junit4]   2> 301033 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:50814__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50814_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50814"}
[junit4:junit4]   2> 301065 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 301065 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 301065 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 301065 T1841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 301065 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 301065 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 301082 T1786 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:48418__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 301083 T1786 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:48418__collection1&state=recovering&nodeName=127.0.0.1:48418_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 301086 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 302088 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C2412_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48418_, base_url=http://127.0.0.1:48418}
[junit4:junit4]   2> 303084 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49256/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 303084 T1846 C2412 P48418 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48418 START replicas=[http://127.0.0.1:49256/collection1/] nUpdates=100
[junit4:junit4]   2> 303084 T1846 C2412 P48418 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 303085 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 303085 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 303085 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 303085 T1846 C2412 P48418 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 303085 T1846 C2412 P48418 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49256/collection1/. core=collection1
[junit4:junit4]   2> 303086 T1846 C2412 P48418 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 303086 T1784 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 303089 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 303092 T1785 C2414 P49256 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 303144 T1785 C2414 P49256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 303145 T1785 C2414 P49256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4]   2> 303145 T1785 C2414 P49256 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 303146 T1785 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 54
[junit4:junit4]   2> 303147 T1846 C2412 P48418 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 303147 T1846 C2412 P48418 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 303149 T1786 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 303149 T1846 C2412 P48418 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 303149 T1846 C2412 P48418 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 303150 T1846 C2412 P48418 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 303152 T1784 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1 
[junit4:junit4]   2> 303152 T1846 C2412 P48418 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 303153 T1846 C2412 P48418 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index.20130619074957708
[junit4:junit4]   2> 303154 T1846 C2412 P48418 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index.20130619074957708 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d9c9f21; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 303156 T1785 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 303157 T1846 C2412 P48418 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 303159 T1846 C2412 P48418 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 303160 T1846 C2412 P48418 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 303161 T1846 C2412 P48418 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 303162 T1846 C2412 P48418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4]   2> 303162 T1846 C2412 P48418 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 303163 T1846 C2412 P48418 oass.SolrIndexSearcher.<init> Opening Searcher@7c52ef9b main
[junit4:junit4]   2> 303163 T1845 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c52ef9b main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 303164 T1846 C2412 P48418 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index.20130619074957708 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index.20130619074957708;done=true>>]
[junit4:junit4]   2> 303164 T1846 C2412 P48418 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index.20130619074957708
[junit4:junit4]   2> 303164 T1846 C2412 P48418 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index.20130619074957708
[junit4:junit4]   2> 303165 T1846 C2412 P48418 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 303165 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 303165 T1846 C2412 P48418 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 303165 T1846 C2412 P48418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 303166 T1846 C2412 P48418 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 304072 T1772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 304073 T1772 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:48418__collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:48418_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:48418"}
[junit4:junit4]   2> 304076 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 304076 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 304076 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 304076 T1841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 304076 T1807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 304077 T1778 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 304090 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 304091 T1749 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C2415 name=collection1 org.apache.solr.core.SolrCore@c58cbd url=http://127.0.0.1:38132/collection1 node=127.0.0.1:38132_ C2415_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:38132_, base_url=http://127.0.0.1:38132, leader=true}
[junit4:junit4]   2> 304101 T1765 C2415 P38132 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 304105 T1765 C2415 P38132 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 304106 T1765 C2415 P38132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 304134 T1765 C2415 P38132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 304135 T1765 C2415 P38132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 304136 T1765 C2415 P38132 oass.SolrIndexSearcher.<init> Opening Searcher@39e172de main
[junit4:junit4]   2> 304136 T1765 C2415 P38132 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 304137 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39e172de main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 304138 T1765 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 37
[junit4:junit4]   2> ASYNC  NEW_CORE C2416 name=collection1 org.apache.solr.core.SolrCore@237b68d0 url=http://127.0.0.1:51672/collection1 node=127.0.0.1:51672_ C2416_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51672_, base_url=http://127.0.0.1:51672}
[junit4:junit4]   2> 304149 T1802 C2416 P51672 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:49256/collection1/, StdNode: http://127.0.0.1:51672/collection1/, StdNode: http://127.0.0.1:50814/collection1/, StdNode: http://127.0.0.1:48418/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 304155 T1803 C2416 P51672 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 304155 T1784 C2414 P49256 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C2413_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50814_, base_url=http://127.0.0.1:50814}
[junit4:junit4]   2> 304161 T1818 C2413 P50814 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C2412_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48418_, base_url=http://127.0.0.1:48418}
[junit4:junit4]   2> 304161 T1837 C2412 P48418 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 304185 T1803 C2416 P51672 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 304185 T1803 C2416 P51672 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 304185 T1784 C2414 P49256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4]   2> 304186 T1784 C2414 P49256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4]   2> 304186 T1803 C2416 P51672 oass.SolrIndexSearcher.<init> Opening Searcher@232e1092 main
[junit4:junit4]   2> 304187 T1784 C2414 P49256 oass.SolrIndexSearcher.<init> Opening Searcher@ccb50bb main
[junit4:junit4]   2> 304187 T1803 C2416 P51672 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 304187 T1784 C2414 P49256 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 304188 T1809 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@232e1092 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 304188 T1803 C2416 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 33
[junit4:junit4]   2> 304189 T1793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ccb50bb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 304190 T1784 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 35
[junit4:junit4]   2> 304204 T1837 C2412 P48418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4]   2> 304205 T1837 C2412 P48418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4]   2> 304204 T1818 C2413 P50814 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 304206 T1818 C2413 P50814 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4]   2> 304207 T1818 C2413 P50814 oass.SolrIndexSearcher.<init> Opening Searcher@19393bfa main
[junit4:junit4]   2> 304207 T1818 C2413 P50814 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 304208 T1826 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19393bfa main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 304206 T1837 C2412 P48418 oass.SolrIndexSearcher.<init> Opening Searcher@49b231f1 main
[junit4:junit4]   2> 304209 T1818 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 48
[junit4:junit4]   2> 304209 T1837 C2412 P48418 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 304210 T1845 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49b231f1 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 304211 T1837 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 50
[junit4:junit4]   2> 304212 T1802 C2416 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 63
[junit4:junit4]   2> 304212 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 304215 T1786 C2414 P49256 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 304217 T1800 C2416 P51672 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 304219 T1817 C2413 P50814 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 304220 T1836 C2412 P48418 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 306225 T1767 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438267736881889280)} 0 2
[junit4:junit4]   2> 306237 T1800 C2416 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438267736891326464&update.from=http://127.0.0.1:49256/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438267736891326464)} 0 1
[junit4:junit4]   2> 306237 T1820 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438267736891326464&update.from=http://127.0.0.1:49256/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438267736891326464)} 0 0
[junit4:junit4]   2> 306237 T1836 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438267736891326464&update.from=http://127.0.0.1:49256/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438267736891326464)} 0 1
[junit4:junit4]   2> 306239 T1786 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438267736891326464)} 0 7
[junit4:junit4]   2> 306239 T1802 C2416 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 11
[junit4:junit4]   2> 306243 T1764 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438267736900763648)]} 0 1
[junit4:junit4]   2> 306257 T1834 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438267736911249408)]} 0 1
[junit4:junit4]   2> 306258 T1801 C2416 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438267736911249408)]} 0 2
[junit4:junit4]   2> 306258 T1818 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438267736911249408)]} 0 2
[junit4:junit4]   2> 306259 T1787 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48418/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438267736911249408)]} 0 8
[junit4:junit4]   2> 306260 T1835 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 15
[junit4:junit4]   2> 306264 T1766 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438267736922783744)]} 0 2
[junit4:junit4]   2> 306273 T1803 C2416 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438267736929075200)]} 0 1
[junit4:junit4]   2> 306273 T1817 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438267736929075200)]} 0 1
[junit4:junit4]   2> 306274 T1836 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438267736929075200)]} 0 1
[junit4:junit4]   2> 306275 T1785 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48418/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438267736929075200)]} 0 6
[junit4:junit4]   2> 306275 T1837 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 9
[junit4:junit4]   2> 306279 T1765 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438267736938512384)]} 0 1
[junit4:junit4]   2> 306284 T1786 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:51672/collection1/]
[junit4:junit4]   2> 306284 T1786 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:51672/collection1/ against:[http://127.0.0.1:51672/collection1/] result:true
[junit4:junit4]   2> 306285 T1786 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50814/collection1/ against:[http://127.0.0.1:51672/collection1/] result:false
[junit4:junit4]   2> 306285 T1786 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:48418/collection1/ against:[http://127.0.0.1:51672/collection1/] result:false
[junit4:junit4]   2> 306289 T1834 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[2 (1438267736945852416)]} 0 1
[junit4:junit4]   2> 306289 T1818 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[2 (1438267736945852416)]} 0 1
[junit4:junit4]   2> 306290 T1786 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50814/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[2 (1438267736945852416)]} 0 7
[junit4:junit4]   2> 306291 T1820 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[2]} 0 10
[junit4:junit4]   2> 306294 T1767 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438267736955289600)]} 0 1
[junit4:junit4]   2> 306299 T1784 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:51672/collection1/]
[junit4:junit4]   2> 306300 T1784 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:51672/collection1/ against:[http://127.0.0.1:51672/collection1/] result:true
[junit4:junit4]   2> 306301 T1784 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50814/collection1/ against:[http://127.0.0.1:51672/collection1/] result:false
[junit4:junit4]   2> 306301 T1784 C2414 P49256 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:48418/collection1/ against:[http://127.0.0.1:51672/collection1/] result:false
[junit4:junit4]   2> 306305 T1836 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[3 (1438267736962629632)]} 0 1
[junit4:junit4]   2> 306305 T1817 C2413 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:49256/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[3 (1438267736962629632)]} 0 1
[junit4:junit4]   2> 306306 T1784 C2414 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48418/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&wt=javabin&version=2} {add=[3 (1438267736962629632)]} 0 7
[junit4:junit4]   2> 306307 T1835 C2412 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:51672/collection1/&test.distrib.skip.servers=http://127.0.0.1:50814/collection1/&wt=javabin&version=2} {add=[3]} 0 10
[junit4:junit4]   2> 306309 T1764 C2415 P38132 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306344 T1764 C2415 P38132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 306345 T1764 C2415 P38132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 306349 T1764 C2415 P38132 oass.SolrIndexSearcher.<init> Opening Searcher@a44c312 main
[junit4:junit4]   2> 306351 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a44c312 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4]   2> 306352 T1764 C2415 P38132 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 306352 T1764 C2415 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 43
[junit4:junit4]   2> 306357 T1837 C2412 P48418 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:49256/collection1/, StdNode: http://127.0.0.1:51672/collection1/, StdNode: http://127.0.0.1:50814/collection1/, StdNode: http://127.0.0.1:48418/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 306360 T1787 C2414 P49256 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306366 T1802 C2416 P51672 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306366 T1818 C2413 P50814 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> ASYNC  NEW_CORE C2417 name=collection1 org.apache.solr.core.SolrCore@6260a433 url=http://127.0.0.1:48418/collection1 node=127.0.0.1:48418_ C2417_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48418_, base_url=http://127.0.0.1:48418}
[junit4:junit4]   2> 306383 T1836 C2417 P48418 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> ASYNC  NEW_CORE C2418 name=collection1 org.apache.solr.core.SolrCore@647c5f84 url=http://127.0.0.1:49256/collection1 node=127.0.0.1:49256_ C2418_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49256_, base_url=http://127.0.0.1:49256, leader=true}
[junit4:junit4]   2> 306425 T1787 C2418 P49256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4]   2> 306425 T1787 C2418 P49256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4]   2> ASYNC  NEW_CORE C2419 name=collection1 org.apache.solr.core.SolrCore@237b68d0 url=http://127.0.0.1:51672/collection1 node=127.0.0.1:51672_ C2419_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51672_, base_url=http://127.0.0.1:51672}
[junit4:junit4]   2> 306426 T1802 C2419 P51672 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6714f23e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> ASYNC  NEW_CORE C2420 name=collection1 org.apache.solr.core.SolrCore@29ab13e3 url=http://127.0.0.1:50814/collection1 node=127.0.0.1:50814_ C2420_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50814_, base_url=http://127.0.0.1:50814}
[junit4:junit4]   2> 306426 T1818 C2420 P50814 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@f33fcf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4]   2> 306426 T1836 C2417 P48418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4]   2> 306427 T1818 C2420 P50814 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4]   2> 306427 T1802 C2419 P51672 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4]   2> 306428 T1836 C2417 P48418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4]   2> 306429 T1787 C2418 P49256 oass.SolrIndexSearcher.<init> Opening Searcher@299fd724 main
[junit4:junit4]   2> 306430 T1818 C2420 P50814 oass.SolrIndexSearcher.<init> Opening Searcher@84d93fd main
[junit4:junit4]   2> 306431 T1802 C2419 P51672 oass.SolrIndexSearcher.<init> Opening Searcher@49142bed main
[junit4:junit4]   2> 306431 T1818 C2420 P50814 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 306431 T1787 C2418 P49256 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 306431 T1793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@299fd724 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4]   2> 306432 T1809 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49142bed main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):c2)}
[junit4:junit4]   2> 306432 T1826 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@84d93fd main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c4)}
[junit4:junit4]   2> 306431 T1836 C2417 P48418 oass.SolrIndexSearcher.<init> Opening Searcher@57d7dc1 main
[junit4:junit4]   2> 306433 T1802 C2419 P51672 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 306433 T1787 C2418 P49256 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 73
[junit4:junit4]   2> 306434 T1802 C2419 P51672 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 68
[junit4:junit4]   2> 306433 T1836 C2417 P48418 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 306433 T1818 C2420 P50814 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 67
[junit4:junit4]   2> 306434 T1845 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57d7dc1 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4]   2> 306436 T1836 C2417 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 53
[junit4:junit4]   2> 306437 T1837 C2417 P48418 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 81
[junit4:junit4]   2> 306437 T1749 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 306438 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 306439 T1749 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 306441 T1785 C2418 P49256 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 306443 T1801 C2419 P51672 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0 
[junit4:junit4]   2> 306446 T1820 C2420 P50814 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 306448 T1835 C2417 P48418 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 306450 T1749 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 306458 T1819 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4]   2> 306459 T1819 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 306464 T1786 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4]   2> 306464 T1786 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49256/collection1/
[junit4:junit4]   2> 306465 T1786 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:49256 START replicas=[http://127.0.0.1:51672/collection1/, http://127.0.0.1:50814/collection1/, http://127.0.0.1:48418/collection1/] nUpdates=100
[junit4:junit4]   2> 306471 T1803 C2419 P51672 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 306472 T1834 C2417 P48418 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 306472 T1818 C2420 P50814 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 306473 T1786 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:49256  Received 3 versions from 127.0.0.1:51672/collection1/
[junit4:junit4]   2> 306473 T1786 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:49256  Our versions are newer. ourLowThreshold=1438267736891326464 otherHigh=1438267736929075200
[junit4:junit4]   2> 306474 T1786 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:49256  Received 5 versions from 127.0.0.1:50814/collection1/
[junit4:junit4]   2> 306474 T1786 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:49256  Our versions are newer. ourLowThreshold=1438267736891326464 otherHigh=1438267736945852416
[junit4:junit4]   2> 306474 T1786 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:49256  Received 5 versions from 127.0.0.1:48418/collection1/
[junit4:junit4]   2> 306475 T1786 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:49256  Our versions are newer. ourLowThreshold=1438267736891326464 otherHigh=1438267736945852416
[junit4:junit4]   2> 306475 T1786 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:49256 DONE. sync succeeded
[junit4:junit4]   2> 306475 T1786 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 306476 T1786 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/: try and ask http://127.0.0.1:51672/collection1/ to sync
[junit4:junit4]   2> 306476 T1786 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/: try and ask http://127.0.0.1:50814/collection1/ to sync
[junit4:junit4]   2> 306477 T1786 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/: try and ask http://127.0.0.1:48418/collection1/ to sync
[junit4:junit4]   2> 306493 T1817 C2420 P50814 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50814 START replicas=[http://127.0.0.1:49256/collection1/] nUpdates=100
[junit4:junit4]   2> 306495 T1802 C2419 P51672 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51672 START replicas=[http://127.0.0.1:49256/collection1/] nUpdates=100
[junit4:junit4]   2> 306495 T1837 C2417 P48418 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48418 START replicas=[http://127.0.0.1:49256/collection1/] nUpdates=100
[junit4:junit4]   2> 306497 T1784 C2418 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 306498 T1817 C2420 P50814 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50814  Received 5 versions from 127.0.0.1:49256/collection1/
[junit4:junit4]   2> 306498 T1787 C2418 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 306498 T1817 C2420 P50814 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50814  Our versions are newer. ourLowThreshold=1438267736891326464 otherHigh=1438267736945852416
[junit4:junit4]   2> 306499 T1802 C2419 P51672 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51672  Received 5 versions from 127.0.0.1:49256/collection1/
[junit4:junit4]   2> 306499 T1817 C2420 P50814 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50814 DONE. sync succeeded
[junit4:junit4]   2> 306499 T1802 C2419 P51672 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:51672 Requesting updates from 127.0.0.1:49256/collection1/n=2 versions=[1438267736962629632, 1438267736945852416]
[junit4:junit4]   2> 306500 T1785 C2418 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 306500 T1817 C2420 P50814 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:49256/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7 
[junit4:junit4]   2> 306501 T1837 C2417 P48418 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48418  Received 5 versions from 127.0.0.1:49256/collection1/
[junit4:junit4]   2> 306501 T1837 C2417 P48418 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48418  Our versions are newer. ourLowThreshold=1438267736891326464 otherHigh=1438267736945852416
[junit4:junit4]   2> 306501 T1837 C2417 P48418 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48418 DONE. sync succeeded
[junit4:junit4]   2> 306502 T1837 C2417 P48418 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:49256/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7 
[junit4:junit4]   2> 306502 T1784 C2418 P49256 oasc.SolrCore.execute [collection1] webapp= path=/get params={distrib=false&getUpdates=1438267736962629632,1438267736945852416&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 306502 T1786 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/:  sync completed with http://127.0.0.1:48418/collection1/
[junit4:junit4]   2> 306503 T1786 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/:  sync completed with http://127.0.0.1:50814/collection1/
[junit4:junit4]   2> 306506 T1802 C2419 P51672 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438267736945852416), 3 (1438267736962629632)]} 0 3
[junit4:junit4]   2> 306507 T1802 C2419 P51672 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51672 DONE. sync succeeded
[junit4:junit4]   2> 306507 T1802 C2419 P51672 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:49256/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=12 
[junit4:junit4]   2> 306508 T1786 oasc.SyncStrategy.syncToMe http://127.0.0.1:49256/collection1/:  sync completed with http://127.0.0.1:51672/collection1/
[junit4:junit4]   2> 306508 T1786 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=44 
[junit4:junit4]   2> 306509 T1819 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=53 
[junit4:junit4]   2> 306509 T1749 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 306509 T1749 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 306510 T1749 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 306511 T1749 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C2421 name=collection1 org.apache.solr.core.SolrCore@c58cbd url=http://127.0.0.1:38132/collection1 node=127.0.0.1:38132_ C2421_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:38132_, base_url=http://127.0.0.1:38132, leader=true}
[junit4:junit4]   2> 306514 T1766 C2421 P38132 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306564 T1766 C2421 P38132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e77ba58; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 306565 T1766 C2421 P38132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4]   2> 306566 T1766 C2421 P38132 oass.SolrIndexSearcher.<init> Opening Searcher@3af92231 main
[junit4:junit4]   2> 306566 T1766 C2421 P38132 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 306567 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3af92231 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4]   2> 306568 T1766 C2421 P38132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 55
[junit4:junit4]   2> 306570 T1787 C2418 P49256 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:49256/collection1/, StdNode: http://127.0.0.1:51672/collection1/, StdNode: http://127.0.0.1:50814/collection1/, StdNode: http://127.0.0.1:48418/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 306571 T1785 C2418 P49256 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306572 T1801 C2419 P51672 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306572 T1835 C2417 P48418 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306572 T1818 C2420 P50814 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 306587 T1785 C2418 P49256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371638980188/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68a4b4f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/

[...truncated too long message...]

        "router":"compositeId"},
[junit4:junit4]   1>         "control_collection":{
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:38132__collection1":{
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:38132_",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:38132",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>   /solr/aliases.json (0)
[junit4:junit4]   1>   /solr/live_nodes (4)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:48418_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:49256_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:50814_ (0)
[junit4:junit4]   1>    /solr/live_nodes/127.0.0.1:38132_ (0)
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/collections (2)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89891732205797386-127.0.0.1:50814__collection1-n_0000000002 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89891732205797388-127.0.0.1:48418__collection1-n_0000000003 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89891732205797390-127.0.0.1:49256__collection1-n_0000000004 (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (1)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:50814_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:50814"}
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89891732205797379-127.0.0.1:38132__collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:38132_",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:38132"}
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (4)
[junit4:junit4]   1>     /solr/overseer_elect/election/89891732205797390-127.0.0.1:49256_-n_0000000005 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89891732205797388-127.0.0.1:48418_-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89891732205797379-127.0.0.1:38132_-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89891732205797386-127.0.0.1:50814_-n_0000000003 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89891732205797379-127.0.0.1:38132_-n_0000000000"}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=3E86E17B11382676 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh -Dtests.timezone=America/Santarem -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE  102s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:49256/collection1lastClient and got 257 from http://127.0.0.1:50814/collection1
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([3E86E17B11382676:BF606F636667464A]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 387161 T1749 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 101542 T1748 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   2> 387190 T1824 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 387190 T1824 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 387191 T1824 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 388285 T1841 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 388286 T1841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 388286 T1841 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=Memory doPackFST= false), text=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=Direct), rnd_b=PostingsFormat(name=Memory doPackFST= true), intDefault=PostingsFormat(name=Direct), id=PostingsFormat(name=Memory doPackFST= true), timestamp=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=Memory doPackFST= false), other_tl1=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Memory doPackFST= false), a_si=PostingsFormat(name=Direct)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=zh, timezone=America/Santarem
[junit4:junit4]   2> NOTE: Linux 3.2.0-48-generic amd64/Sun Microsystems Inc. 1.6.0_45 (64-bit)/cpus=8,threads=3,free=115497408,total=530186240
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestFastLRUCache, RAMDirectoryFactoryTest, TestLFUCache, LeaderElectionTest, AutoCommitTest, DistributedQueryElevationComponentTest, QueryEqualityTest, TestIBSimilarityFactory, TestSolrQueryParser, DirectUpdateHandlerOptimizeTest, TestPHPSerializedResponseWriter, AnalysisAfterCoreReloadTest, TestReplicationHandler, ChaosMonkeyNothingIsSafeTest, TestConfig, DocValuesTest, TestCollationKeyRangeQueries, IndexSchemaTest, TestRealTimeGet, DirectSolrConnectionTest, TestClassNameShortening, ResponseLogComponentTest, SliceStateTest, SchemaVersionSpecificBehaviorTest, RegexBoostProcessorTest, SliceStateUpdateTest, OverseerTest, TestSearchPerf, TestSerializedLuceneMatchVersion, SolrIndexSplitterTest, TestSurroundQueryParser, DocumentBuilderTest, TestRandomDVFaceting, TestPseudoReturnFields, CachingDirectoryFactoryTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 102.85s, 1 test, 1 failure <<< FAILURES!

[...truncated 710 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:392: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:372: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1246: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:890: There were test failures: 298 suites, 1253 tests, 1 failure, 13 ignored (7 assumptions)

Total time: 43 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0_45 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_21) - Build # 6138 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6138/
Java: 32bit/jdk1.7.0_21 -server -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.lucene.index.TestFieldsReader.testExceptions

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
	at __randomizedtesting.SeedInfo.seed([A3AC19F388354DBF:D5AD4B5B20483309]:0)
	at org.apache.lucene.util.BytesRef.copyBytes(BytesRef.java:196)
	at org.apache.lucene.util.BytesRef.deepCopyOf(BytesRef.java:343)
	at org.apache.lucene.codecs.lucene3x.TermBuffer.toTerm(TermBuffer.java:113)
	at org.apache.lucene.codecs.lucene3x.SegmentTermEnum.term(SegmentTermEnum.java:184)
	at org.apache.lucene.codecs.lucene3x.Lucene3xFields$PreTermsEnum.next(Lucene3xFields.java:863)
	at org.apache.lucene.index.MultiTermsEnum.pushTop(MultiTermsEnum.java:292)
	at org.apache.lucene.index.MultiTermsEnum.next(MultiTermsEnum.java:318)
	at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:103)
	at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)
	at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)
	at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)
	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3767)
	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3371)
	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1887)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1697)
	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
	at org.apache.lucene.index.TestFieldsReader.testExceptions(TestFieldsReader.java:204)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)




Build Log:
[...truncated 355 lines...]
[junit4:junit4] Suite: org.apache.lucene.index.TestFieldsReader
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFieldsReader -Dtests.method=testExceptions -Dtests.seed=A3AC19F388354DBF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mt_MT -Dtests.timezone=Europe/Samara -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   1.49s J0 | TestFieldsReader.testExceptions <<<
[junit4:junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([A3AC19F388354DBF:D5AD4B5B20483309]:0)
[junit4:junit4]    > 	at org.apache.lucene.util.BytesRef.copyBytes(BytesRef.java:196)
[junit4:junit4]    > 	at org.apache.lucene.util.BytesRef.deepCopyOf(BytesRef.java:343)
[junit4:junit4]    > 	at org.apache.lucene.codecs.lucene3x.TermBuffer.toTerm(TermBuffer.java:113)
[junit4:junit4]    > 	at org.apache.lucene.codecs.lucene3x.SegmentTermEnum.term(SegmentTermEnum.java:184)
[junit4:junit4]    > 	at org.apache.lucene.codecs.lucene3x.Lucene3xFields$PreTermsEnum.next(Lucene3xFields.java:863)
[junit4:junit4]    > 	at org.apache.lucene.index.MultiTermsEnum.pushTop(MultiTermsEnum.java:292)
[junit4:junit4]    > 	at org.apache.lucene.index.MultiTermsEnum.next(MultiTermsEnum.java:318)
[junit4:junit4]    > 	at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:103)
[junit4:junit4]    > 	at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)
[junit4:junit4]    > 	at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)
[junit4:junit4]    > 	at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3767)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3371)
[junit4:junit4]    > 	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1887)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1697)
[junit4:junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1650)
[junit4:junit4]    > 	at org.apache.lucene.index.TestFieldsReader.testExceptions(TestFieldsReader.java:204)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=mt_MT, timezone=Europe/Samara
[junit4:junit4]   2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.7.0_21 (32-bit)/cpus=8,threads=1,free=201998448,total=512491520
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterMerging, TestDeterminism, TestLucene3xTermVectorsFormat, TestLookaheadTokenFilter, TestSimpleExplanations, TestSegmentReader, TestPhrasePrefixQuery, TestSearchAfter, TestSearcherManager, TestFieldsReader]
[junit4:junit4] Completed on J0 in 1.76s, 2 tests, 1 error <<< FAILURES!

[...truncated 1023 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:392: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:372: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:49: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1246: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:890: There were test failures: 364 suites, 2312 tests, 1 error, 48 ignored (35 assumptions)

Total time: 7 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jrockit-jdk1.6.0_37-R28.2.5-4.1.0) - Build # 6137 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6137/
Java: 32bit/jrockit-jdk1.6.0_37-R28.2.5-4.1.0 -XnoOpt

1 tests failed.
REGRESSION:  org.apache.solr.cloud.RecoveryZkTest.testDistribSearch

Error Message:
expected:<2352> but was:<60>

Stack Trace:
java.lang.AssertionError: expected:<2352> but was:<60>
	at __randomizedtesting.SeedInfo.seed([A51E79EAB8B31674:24F8F7F2CFEC7648]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:774)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:683)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:44)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8745 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4]   2> 136627 T675 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wu_z/
[junit4:junit4]   2> 136651 T675 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-RecoveryZkTest-1371644659656
[junit4:junit4]   2> 136652 T675 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 136652 T676 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 136752 T675 oasc.ZkTestServer.run start zk server on port:45749
[junit4:junit4]   2> 136753 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 136918 T682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b3a99d9 name:ZooKeeperConnection Watcher:127.0.0.1:45749 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 136918 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 136919 T675 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 136922 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 136923 T684 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b3af368 name:ZooKeeperConnection Watcher:127.0.0.1:45749/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 136923 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 136924 T675 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 136926 T675 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 136927 T675 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 136928 T675 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 136930 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 136930 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 136934 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 136934 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 136937 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 136937 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 136939 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 136939 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 136941 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 136942 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 136944 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 136944 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 136946 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 136947 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 136949 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 136949 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 136951 T675 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 136951 T675 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 137063 T675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 137067 T675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33152
[junit4:junit4]   2> 137067 T675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 137067 T675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 137068 T675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958
[junit4:junit4]   2> 137068 T675 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/solr.xml
[junit4:junit4]   2> 137069 T675 oasc.CoreContainer.<init> New CoreContainer 452803626
[junit4:junit4]   2> 137070 T675 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/'
[junit4:junit4]   2> 137070 T675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/'
[junit4:junit4]   2> 137151 T675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 137152 T675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 137152 T675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 137153 T675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 137153 T675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 137154 T675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 137154 T675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 137155 T675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 137155 T675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 137155 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 137160 T675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 137161 T675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45749/solr
[junit4:junit4]   2> 137161 T675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 137162 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 137163 T695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b015bef name:ZooKeeperConnection Watcher:127.0.0.1:45749 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 137164 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 137165 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 137169 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 137170 T697 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b02cc18 name:ZooKeeperConnection Watcher:127.0.0.1:45749/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 137170 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 137171 T675 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 137174 T675 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 137176 T675 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 137177 T675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33152_wu_z
[junit4:junit4]   2> 137178 T675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33152_wu_z
[junit4:junit4]   2> 137180 T675 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 137183 T675 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 137184 T675 oasc.Overseer.start Overseer (id=89892104415346691-127.0.0.1:33152_wu_z-n_0000000000) starting
[junit4:junit4]   2> 137186 T675 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 137188 T699 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 137189 T675 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 137191 T675 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 137192 T675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 137195 T698 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 137198 T700 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 137198 T700 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 138698 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 138698 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33152_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33152/wu_z"}
[junit4:junit4]   2> 138699 T698 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 138699 T698 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 138701 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 139199 T700 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/collection1
[junit4:junit4]   2> 139199 T700 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 139200 T700 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 139200 T700 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 139201 T700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/collection1/'
[junit4:junit4]   2> 139202 T700 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/collection1/lib/README' to classloader
[junit4:junit4]   2> 139202 T700 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 139236 T700 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 139292 T700 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 139294 T700 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 139302 T700 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 139861 T700 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 139871 T700 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 139874 T700 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 139884 T700 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 139888 T700 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 139893 T700 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 139893 T700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 139894 T700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 139894 T700 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 139895 T700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 139895 T700 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 139895 T700 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 139895 T700 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371644659958/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/control/data/
[junit4:junit4]   2> 139896 T700 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1af03ced
[junit4:junit4]   2> 139896 T700 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 139896 T700 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/control/data
[junit4:junit4]   2> 139897 T700 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/control/data/index/
[junit4:junit4]   2> 139897 T700 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1371644659656/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 139897 T700 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/control/data/index
[junit4:junit4]   2> 139899 T700 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b18e683 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b18ed50),segFN=segments_1,generation=1}
[junit4:junit4]   2> 139899 T700 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 139901 T700 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 139901 T700 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 139901 T700 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 139902 T700 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 139902 T700 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 139902 T700 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 139903 T700 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 139903 T700 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 139904 T700 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 139906 T700 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 139909 T700 oass.SolrIndexSearcher.<init> Opening Searcher@1b1f077c main
[junit4:junit4]   2> 139909 T700 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/control/data/tlog
[junit4:junit4]   2> 139910 T700 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 139910 T700 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 139914 T701 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b1f077c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 139915 T700 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 139915 T700 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33152/wu_z collection:control_collection shard:shard1
[junit4:junit4]   2> 139916 T700 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 139920 T700 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 139921 T700 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 139921 T700 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 139922 T700 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33152/wu_z/collection1/
[junit4:junit4]   2> 139922 T700 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 139922 T700 oasc.SyncStrategy.syncToMe http://127.0.0.1:33152/wu_z/collection1/ has no replicas
[junit4:junit4]   2> 139922 T700 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33152/wu_z/collection1/
[junit4:junit4]   2> 139922 T700 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 140204 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 140272 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 140276 T700 oasc.ZkController.register We are http://127.0.0.1:33152/wu_z/collection1/ and leader is http://127.0.0.1:33152/wu_z/collection1/
[junit4:junit4]   2> 140276 T700 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33152/wu_z
[junit4:junit4]   2> 140277 T700 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 140277 T700 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 140277 T700 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 140278 T700 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 140279 T675 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 140279 T675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 140280 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 140285 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 140286 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 140287 T704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b2ca13f name:ZooKeeperConnection Watcher:127.0.0.1:45749/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 140287 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 140288 T675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 140290 T675 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 140382 T675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 140384 T675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50898
[junit4:junit4]   2> 140385 T675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 140385 T675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 140385 T675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294
[junit4:junit4]   2> 140386 T675 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/solr.xml
[junit4:junit4]   2> 140386 T675 oasc.CoreContainer.<init> New CoreContainer 455709404
[junit4:junit4]   2> 140387 T675 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/'
[junit4:junit4]   2> 140387 T675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/'
[junit4:junit4]   2> 140454 T675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 140455 T675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 140455 T675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 140455 T675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 140456 T675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 140456 T675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 140456 T675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 140457 T675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 140457 T675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 140458 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 140461 T675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 140462 T675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45749/solr
[junit4:junit4]   2> 140462 T675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 140463 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 140465 T715 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af60ec5 name:ZooKeeperConnection Watcher:127.0.0.1:45749 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 140465 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 140466 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 140469 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 140470 T717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af6fef8 name:ZooKeeperConnection Watcher:127.0.0.1:45749/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 140470 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 140472 T675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 141474 T675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50898_wu_z
[junit4:junit4]   2> 141476 T675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50898_wu_z
[junit4:junit4]   2> 141478 T717 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 141478 T697 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 141478 T704 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 141478 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 141483 T718 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 141483 T718 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 141776 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 141776 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33152_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33152/wu_z"}
[junit4:junit4]   2> 141779 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50898_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50898/wu_z"}
[junit4:junit4]   2> 141779 T698 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 141780 T698 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 141783 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 141783 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 141783 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 142484 T718 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/collection1
[junit4:junit4]   2> 142484 T718 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 142485 T718 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 142485 T718 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 142487 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/collection1/'
[junit4:junit4]   2> 142487 T718 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/collection1/lib/README' to classloader
[junit4:junit4]   2> 142487 T718 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 142528 T718 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 142582 T718 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 142584 T718 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 142589 T718 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 143103 T718 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 143111 T718 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 143115 T718 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 143124 T718 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 143128 T718 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 143133 T718 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 143134 T718 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 143134 T718 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 143135 T718 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 143135 T718 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 143136 T718 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 143136 T718 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 143136 T718 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371644663294/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty1/
[junit4:junit4]   2> 143137 T718 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1af03ced
[junit4:junit4]   2> 143137 T718 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 143138 T718 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty1
[junit4:junit4]   2> 143138 T718 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty1/index/
[junit4:junit4]   2> 143139 T718 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 143139 T718 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty1/index
[junit4:junit4]   2> 143142 T718 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1afe8b5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1afe922b),segFN=segments_1,generation=1}
[junit4:junit4]   2> 143142 T718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 143144 T718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 143144 T718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 143145 T718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 143146 T718 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 143147 T718 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 143147 T718 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 143148 T718 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 143149 T718 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 143150 T718 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 143153 T718 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 143156 T718 oass.SolrIndexSearcher.<init> Opening Searcher@1af41a54 main
[junit4:junit4]   2> 143156 T718 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty1/tlog
[junit4:junit4]   2> 143157 T718 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 143157 T718 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 143163 T719 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1af41a54 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 143165 T718 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 143166 T718 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50898/wu_z collection:collection1 shard:shard1
[junit4:junit4]   2> 143166 T718 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 143170 T718 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 143172 T718 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 143172 T718 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 143172 T718 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50898/wu_z/collection1/
[junit4:junit4]   2> 143173 T718 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 143173 T718 oasc.SyncStrategy.syncToMe http://127.0.0.1:50898/wu_z/collection1/ has no replicas
[junit4:junit4]   2> 143173 T718 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50898/wu_z/collection1/
[junit4:junit4]   2> 143173 T718 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 143287 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 143296 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 143297 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 143298 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 143328 T718 oasc.ZkController.register We are http://127.0.0.1:50898/wu_z/collection1/ and leader is http://127.0.0.1:50898/wu_z/collection1/
[junit4:junit4]   2> 143328 T718 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50898/wu_z
[junit4:junit4]   2> 143328 T718 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 143329 T718 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 143329 T718 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 143332 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 143337 T675 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 143338 T675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 143338 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 143494 T675 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 143497 T675 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57762
[junit4:junit4]   2> 143500 T675 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 143500 T675 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 143501 T675 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346
[junit4:junit4]   2> 143501 T675 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/solr.xml
[junit4:junit4]   2> 143501 T675 oasc.CoreContainer.<init> New CoreContainer 454754439
[junit4:junit4]   2> 143502 T675 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/'
[junit4:junit4]   2> 143502 T675 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/'
[junit4:junit4]   2> 143623 T675 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 143623 T675 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 143624 T675 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 143624 T675 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 143625 T675 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 143625 T675 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 143626 T675 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 143626 T675 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 143627 T675 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 143627 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 143632 T675 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 143633 T675 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45749/solr
[junit4:junit4]   2> 143634 T675 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 143635 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 143636 T731 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1add2a4b name:ZooKeeperConnection Watcher:127.0.0.1:45749 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 143637 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 143638 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 143643 T675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 143644 T733 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ae5daaf name:ZooKeeperConnection Watcher:127.0.0.1:45749/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 143644 T675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 143647 T675 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 144652 T675 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57762_wu_z
[junit4:junit4]   2> 144653 T675 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57762_wu_z
[junit4:junit4]   2> 144655 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 144655 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 144655 T697 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 144656 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 144656 T733 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 144657 T717 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 144657 T704 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 144662 T734 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 144662 T734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 144805 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 144806 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50898_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50898/wu_z"}
[junit4:junit4]   2> 144809 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57762_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57762/wu_z"}
[junit4:junit4]   2> 144809 T698 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 144809 T698 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 144812 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 144812 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 144812 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 144813 T733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 145663 T734 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/collection1
[junit4:junit4]   2> 145664 T734 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 145664 T734 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 145664 T734 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 145666 T734 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/collection1/'
[junit4:junit4]   2> 145666 T734 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/collection1/lib/README' to classloader
[junit4:junit4]   2> 145667 T734 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 145716 T734 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 145770 T734 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 145771 T734 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 145777 T734 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 146286 T734 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 146295 T734 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 146298 T734 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 146309 T734 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 146312 T734 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 146315 T734 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 146316 T734 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 146316 T734 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 146316 T734 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 146317 T734 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 146318 T734 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 146318 T734 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 146318 T734 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371644666346/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/
[junit4:junit4]   2> 146318 T734 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1af03ced
[junit4:junit4]   2> 146319 T734 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 146319 T734 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2
[junit4:junit4]   2> 146319 T734 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/index/
[junit4:junit4]   2> 146320 T734 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 146320 T734 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/index
[junit4:junit4]   2> 146321 T734 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b257985 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b258052),segFN=segments_1,generation=1}
[junit4:junit4]   2> 146322 T734 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 146323 T734 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 146323 T734 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 146324 T734 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 146324 T734 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 146325 T734 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 146326 T734 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 146326 T734 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 146326 T734 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 146327 T734 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 146329 T734 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 146332 T734 oass.SolrIndexSearcher.<init> Opening Searcher@1b39547f main
[junit4:junit4]   2> 146332 T734 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/tlog
[junit4:junit4]   2> 146333 T734 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 146333 T734 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 146338 T735 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b39547f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 146340 T734 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 146340 T734 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57762/wu_z collection:collection1 shard:shard1
[junit4:junit4]   2> 146343 T734 oasc.ZkController.register We are http://127.0.0.1:57762/wu_z/collection1/ and leader is http://127.0.0.1:50898/wu_z/collection1/
[junit4:junit4]   2> 146343 T734 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57762/wu_z
[junit4:junit4]   2> 146343 T734 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 146343 T734 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C262 name=collection1 org.apache.solr.core.SolrCore@1b24f2c7 url=http://127.0.0.1:57762/wu_z/collection1 node=127.0.0.1:57762_wu_z C262_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:57762_wu_z, base_url=http://127.0.0.1:57762/wu_z}
[junit4:junit4]   2> 146344 T736 C262 P57762 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 146344 T734 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 146344 T736 C262 P57762 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 146345 T736 C262 P57762 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 146345 T736 C262 P57762 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 146345 T675 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 146345 T675 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 146346 T675 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 146346 T736 C262 P57762 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 146350 T675 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 146350 T712 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> ASYNC  NEW_CORE C263 name=collection1 org.apache.solr.core.SolrCore@1b1866aa url=http://127.0.0.1:33152/wu_z/collection1 node=127.0.0.1:33152_wu_z C263_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:33152_wu_z, base_url=http://127.0.0.1:33152/wu_z, leader=true}
[junit4:junit4]   2> 146397 T693 C263 P33152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b18e683 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b18ed50),segFN=segments_1,generation=1}
[junit4:junit4]   2> 146398 T693 C263 P33152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 146402 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[1 (1438273680861822976)]} 0 25
[junit4:junit4]   2> 146402 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10001 (1438273680861822977)]} 0 25
[junit4:junit4]   2> ASYNC  NEW_CORE C264 name=collection1 org.apache.solr.core.SolrCore@1afe084a url=http://127.0.0.1:50898/wu_z/collection1 node=127.0.0.1:50898_wu_z C264_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50898_wu_z, base_url=http://127.0.0.1:50898/wu_z, leader=true}
[junit4:junit4]   2> 146420 T710 C264 P50898 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1afe8b5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1afe922b),segFN=segments_1,generation=1}
[junit4:junit4]   2> 146421 T710 C264 P50898 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 146423 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[1 (1438273680884891648)]} 0 4
[junit4:junit4]   2> 146423 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10001 (1438273680886988800)]} 0 2
[junit4:junit4]   2> 146432 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[1 (-1438273680898523136)]} 0 0
[junit4:junit4]   2> 146433 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10001 (-1438273680899571712)]} 0 1
[junit4:junit4]   2> 146435 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[1 (-1438273680901668864)]} 0 1
[junit4:junit4]   2> 146435 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10001 (-1438273680901668865)]} 0 0
[junit4:junit4]   2> 146438 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[2 (1438273680903766016)]} 0 1
[junit4:junit4]   2> 146438 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10002 (1438273680903766017)]} 0 1
[junit4:junit4]   2> 146440 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[2 (1438273680906911744)]} 0 0
[junit4:junit4]   2> 146441 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10002 (1438273680906911745)]} 0 1
[junit4:junit4]   2> 146484 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[3 (1438273680952000512)]} 0 1
[junit4:junit4]   2> 146484 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10003 (1438273680953049088)]} 0 0
[junit4:junit4]   2> 146486 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[3 (1438273680955146240)]} 0 0
[junit4:junit4]   2> 146487 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10003 (1438273680955146241)]} 0 1
[junit4:junit4]   2> 146502 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[4 (1438273680971923456)]} 0 1
[junit4:junit4]   2> 146502 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10004 (1438273680971923457)]} 0 0
[junit4:junit4]   2> 146504 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[4 (1438273680974020608)]} 0 0
[junit4:junit4]   2> 146505 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10004 (1438273680974020609)]} 0 1
[junit4:junit4]   2> 146553 T675 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57762
[junit4:junit4]   2> 146553 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10005 (1438273681025400832)]} 0 0
[junit4:junit4]   2> 146554 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[5 (1438273681025400833)]} 0 1
[junit4:junit4]   2> 146553 T675 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=454754439
[junit4:junit4]   2> 146556 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10005 (1438273681027497984)]} 0 1
[junit4:junit4]   2> 146556 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[5 (1438273681028546560)]} 0 0
[junit4:junit4]   2> 146640 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10005 (-1438273681115578368)]} 0 1
[junit4:junit4]   2> 146640 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[5 (-1438273681115578369)]} 0 1
[junit4:junit4]   2> 146642 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10005 (-1438273681118724096)]} 0 0
[junit4:junit4]   2> 146642 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[5 (-1438273681118724097)]} 0 0
[junit4:junit4]   2> 146644 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10006 (1438273681120821248)]} 0 0
[junit4:junit4]   2> 146644 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[6 (1438273681120821249)]} 0 0
[junit4:junit4]   2> 146646 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10006 (1438273681122918400)]} 0 0
[junit4:junit4]   2> 146647 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[6 (1438273681122918401)]} 0 1
[junit4:junit4]   2> 146744 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10007 (1438273681225678848)]} 0 0
[junit4:junit4]   2> 146745 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[7 (1438273681225678849)]} 0 1
[junit4:junit4]   2> 146747 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10007 (1438273681227776000)]} 0 1
[junit4:junit4]   2> 146747 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[7 (1438273681228824576)]} 0 0
[junit4:junit4]   2> 146767 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10008 (1438273681248747520)]} 0 1
[junit4:junit4]   2> 146767 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[8 (1438273681248747521)]} 0 1
[junit4:junit4]   2> 146769 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10008 (1438273681251893248)]} 0 1
[junit4:junit4]   2> 146769 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[8 (1438273681251893249)]} 0 0
[junit4:junit4]   2> 146856 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10009 (1438273681342070784)]} 0 1
[junit4:junit4]   2> 146856 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[9 (1438273681342070785)]} 0 1
[junit4:junit4]   2> 146858 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10009 (1438273681345216512)]} 0 0
[junit4:junit4]   2> 146858 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[9 (1438273681345216513)]} 0 0
[junit4:junit4]   2> 146899 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10010 (1438273681387159552)]} 0 1
[junit4:junit4]   2> 146899 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10 (1438273681387159553)]} 0 1
[junit4:junit4]   2> 146901 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10010 (1438273681390305280)]} 0 0
[junit4:junit4]   2> 146902 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10 (1438273681390305281)]} 0 1
[junit4:junit4]   2> 147002 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10007 (-1438273681496211456)]} 0 0
[junit4:junit4]   2> 147003 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[7 (-1438273681497260032)]} 0 0
[junit4:junit4]   2> 147004 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10007 (-1438273681498308608)]} 0 0
[junit4:junit4]   2> 147005 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[7 (-1438273681499357184)]} 0 0
[junit4:junit4]   2> 147007 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10011 (1438273681500405760)]} 0 1
[junit4:junit4]   2> 147007 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[11 (1438273681500405761)]} 0 1
[junit4:junit4]   2> 147009 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10011 (1438273681502502912)]} 0 1
[junit4:junit4]   2> 147009 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[11 (1438273681503551488)]} 0 0
[junit4:junit4]   2> 147069 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10011 (-1438273681566466048)]} 0 0
[junit4:junit4]   2> 147069 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[11 (-1438273681566466049)]} 0 0
[junit4:junit4]   2> 147071 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10011 (-1438273681568563200)]} 0 0
[junit4:junit4]   2> 147072 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[11 (-1438273681568563201)]} 0 1
[junit4:junit4]   2> 147074 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10012 (1438273681570660352)]} 0 1
[junit4:junit4]   2> 147074 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[12 (1438273681570660353)]} 0 1
[junit4:junit4]   2> 147076 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10012 (1438273681573806080)]} 0 0
[junit4:junit4]   2> 147076 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[12 (1438273681573806081)]} 0 0
[junit4:junit4]   2> 147103 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10013 (1438273681602117632)]} 0 0
[junit4:junit4]   2> 147104 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[13 (1438273681602117633)]} 0 1
[junit4:junit4]   2> 147106 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10013 (1438273681604214784)]} 0 1
[junit4:junit4]   2> 147106 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[13 (1438273681605263360)]} 0 0
[junit4:junit4]   2> 147150 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[14 (1438273681651400704)]} 0 0
[junit4:junit4]   2> 147151 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10014 (1438273681651400705)]} 0 1
[junit4:junit4]   2> 147153 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[14 (1438273681653497856)]} 0 1
[junit4:junit4]   2> 147153 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10014 (1438273681654546432)]} 0 0
[junit4:junit4]   2> 147172 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[12 (-1438273681674469376)]} 0 0
[junit4:junit4]   2> 147172 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10012 (-1438273681674469377)]} 0 0
[junit4:junit4]   2> 147174 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[12 (-1438273681676566528)]} 0 0
[junit4:junit4]   2> 147175 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10012 (-1438273681677615104)]} 0 0
[junit4:junit4]   2> 147177 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[15 (1438273681678663680)]} 0 1
[junit4:junit4]   2> 147177 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10015 (1438273681679712256)]} 0 0
[junit4:junit4]   2> 147179 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[15 (1438273681681809408)]} 0 1
[junit4:junit4]   2> 147179 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10015 (1438273681681809409)]} 0 0
[junit4:junit4]   2> 147194 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[13 (-1438273681697538048)]} 0 1
[junit4:junit4]   2> 147194 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10013 (-1438273681697538049)]} 0 1
[junit4:junit4]   2> 147196 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[13 (-1438273681699635200)]} 0 1
[junit4:junit4]   2> 147196 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10013 (-1438273681699635201)]} 0 0
[junit4:junit4]   2> 147198 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[16 (1438273681701732352)]} 0 0
[junit4:junit4]   2> 147199 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10016 (1438273681701732353)]} 0 1
[junit4:junit4]   2> 147200 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[16 (1438273681703829504)]} 0 0
[junit4:junit4]   2> 147201 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10016 (1438273681704878080)]} 0 0
[junit4:junit4]   2> 147260 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[17 (1438273681765695488)]} 0 1
[junit4:junit4]   2> 147260 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10017 (1438273681766744064)]} 0 0
[junit4:junit4]   2> 147262 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[17 (1438273681768841216)]} 0 0
[junit4:junit4]   2> 147262 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10017 (1438273681768841217)]} 0 0
[junit4:junit4]   2> 147312 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[18 (1438273681820221440)]} 0 1
[junit4:junit4]   2> 147312 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10018 (1438273681820221441)]} 0 1
[junit4:junit4]   2> 147314 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[18 (1438273681823367168)]} 0 0
[junit4:junit4]   2> 147315 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10018 (1438273681823367169)]} 0 1
[junit4:junit4]   2> 147326 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[19 (1438273681835950080)]} 0 0
[junit4:junit4]   2> 147326 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10019 (1438273681835950081)]} 0 0
[junit4:junit4]   2> 147328 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[19 (1438273681838047232)]} 0 0
[junit4:junit4]   2> 147329 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10019 (1438273681838047233)]} 0 1
[junit4:junit4]   2> 147427 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[20 (1438273681941856256)]} 0 0
[junit4:junit4]   2> 147428 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10020 (1438273681941856257)]} 0 1
[junit4:junit4]   2> 147430 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[20 (1438273681943953408)]} 0 1
[junit4:junit4]   2> 147430 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10020 (1438273681945001984)]} 0 0
[junit4:junit4]   2> 147503 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[21 (1438273682020499456)]} 0 1
[junit4:junit4]   2> 147503 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10021 (1438273682020499457)]} 0 1
[junit4:junit4]   2> 147505 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[21 (1438273682023645184)]} 0 0
[junit4:junit4]   2> 147506 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10021 (1438273682023645185)]} 0 1
[junit4:junit4]   2> 147549 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[16 (-1438273682069782528)]} 0 0
[junit4:junit4]   2> 147550 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10016 (-1438273682070831104)]} 0 0
[junit4:junit4]   2> 147552 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[16 (-1438273682071879680)]} 0 1
[junit4:junit4]   2> 147552 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10016 (-1438273682072928256)]} 0 0
[junit4:junit4]   2> 147554 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[22 (1438273682073976832)]} 0 1
[junit4:junit4]   2> 147554 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10022 (1438273682075025408)]} 0 0
[junit4:junit4]   2> 147554 T675 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 147555 T675 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 147556 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[22 (1438273682077122560)]} 0 0
[junit4:junit4]   2> 147557 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10022 (1438273682077122561)]} 0 1
[junit4:junit4]   2> 147557 T675 oasc.RecoveryStrategy.close WARN Stopping recovery for zkNodeName=3core=collection1
[junit4:junit4]   2> 147610 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10018 (-1438273682133745664)]} 0 0
[junit4:junit4]   2> 147610 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[18 (-1438273682133745665)]} 0 0
[junit4:junit4]   2> 147612 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10018 (-1438273682135842816)]} 0 0
[junit4:junit4]   2> 147613 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[18 (-1438273682135842817)]} 0 1
[junit4:junit4]   2> 147615 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10023 (1438273682137939968)]} 0 1
[junit4:junit4]   2> 147615 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[23 (1438273682138988544)]} 0 0
[junit4:junit4]   2> 147617 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10023 (1438273682141085696)]} 0 1
[junit4:junit4]   2> 147617 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[23 (1438273682141085697)]} 0 0
[junit4:junit4]   2> 147646 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[24 (1438273682170445825)]} 0 1
[junit4:junit4]   2> 147646 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10024 (1438273682170445824)]} 0 1
[junit4:junit4]   2> 147649 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[24 (1438273682173591552)]} 0 1
[junit4:junit4]   2> 147649 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10024 (1438273682174640128)]} 0 1
[junit4:junit4]   2> 147713 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[25 (1438273682240700416)]} 0 1
[junit4:junit4]   2> 147713 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10025 (1438273682240700417)]} 0 1
[junit4:junit4]   2> 147715 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[25 (1438273682243846144)]} 0 0
[junit4:junit4]   2> 147716 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10025 (1438273682243846145)]} 0 1
[junit4:junit4]   2> 147763 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[26 (1438273682294177792)]} 0 1
[junit4:junit4]   2> 147764 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10026 (1438273682294177793)]} 0 1
[junit4:junit4]   2> 147766 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[26 (1438273682296274944)]} 0 1
[junit4:junit4]   2> 147766 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10026 (1438273682297323520)]} 0 0
[junit4:junit4]   2> 147818 T698 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 147819 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57762_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57762/wu_z"}
[junit4:junit4]   2> 147821 T698 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57762_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57762/wu_z"}
[junit4:junit4]   2> 147824 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 147824 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 147824 T733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 147825 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 147863 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[27 (1438273682397986817)]} 0 1
[junit4:junit4]   2> 147863 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10027 (1438273682397986816)]} 0 1
[junit4:junit4]   2> 147865 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[27 (1438273682401132544)]} 0 0
[junit4:junit4]   2> 147866 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10027 (1438273682401132545)]} 0 1
[junit4:junit4]   2> 147877 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[19 (-1438273682413715456)]} 0 0
[junit4:junit4]   2> 147878 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10019 (-1438273682414764032)]} 0 0
[junit4:junit4]   2> 147879 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[19 (-1438273682415812608)]} 0 0
[junit4:junit4]   2> 147880 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10019 (-1438273682416861184)]} 0 0
[junit4:junit4]   2> 147882 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[28 (1438273682417909760)]} 0 1
[junit4:junit4]   2> 147882 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10028 (1438273682418958336)]} 0 0
[junit4:junit4]   2> 147884 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[28 (1438273682421055488)]} 0 0
[junit4:junit4]   2> 147885 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10028 (1438273682422104064)]} 0 1
[junit4:junit4]   2> 147982 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[29 (1438273682523815936)]} 0 0
[junit4:junit4]   2> 147983 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10029 (1438273682523815937)]} 0 1
[junit4:junit4]   2> 147985 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[29 (1438273682526961664)]} 0 1
[junit4:junit4]   2> 147985 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10029 (1438273682526961665)]} 0 0
[junit4:junit4]   2> 148045 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[20 (-1438273682589876224)]} 0 1
[junit4:junit4]   2> 148045 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10020 (-1438273682589876225)]} 0 1
[junit4:junit4]   2> 148048 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[20 (-1438273682593021952)]} 0 0
[junit4:junit4]   2> 148048 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10020 (-1438273682593021953)]} 0 0
[junit4:junit4]   2> 148050 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[30 (1438273682595119104)]} 0 0
[junit4:junit4]   2> 148051 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10030 (1438273682595119105)]} 0 1
[junit4:junit4]   2> 148053 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[30 (1438273682597216256)]} 0 1
[junit4:junit4]   2> 148053 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10030 (1438273682598264832)]} 0 1
[junit4:junit4]   2> 148122 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[31 (1438273682669568000)]} 0 1
[junit4:junit4]   2> 148123 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10031 (1438273682670616576)]} 0 1
[junit4:junit4]   2> 148124 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[31 (1438273682672713728)]} 0 0
[junit4:junit4]   2> 148125 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10031 (1438273682673762304)]} 0 0
[junit4:junit4]   2> 148210 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[32 (1438273682762891264)]} 0 0
[junit4:junit4]   2> 148211 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10032 (1438273682762891265)]} 0 1
[junit4:junit4]   2> 148213 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[32 (1438273682764988416)]} 0 1
[junit4:junit4]   2> 148213 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10032 (1438273682766036992)]} 0 0
[junit4:junit4]   2> 148250 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[33 (1438273682803785728)]} 0 1
[junit4:junit4]   2> 148250 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10033 (1438273682804834304)]} 0 1
[junit4:junit4]   2> 148252 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[33 (1438273682806931456)]} 0 0
[junit4:junit4]   2> 148253 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10033 (1438273682806931457)]} 0 1
[junit4:junit4]   2> 148314 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[21 (-1438273682871943168)]} 0 0
[junit4:junit4]   2> 148314 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10021 (-1438273682871943169)]} 0 0
[junit4:junit4]   2> 148316 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[21 (-1438273682874040320)]} 0 0
[junit4:junit4]   2> 148317 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10021 (-1438273682875088896)]} 0 1
[junit4:junit4]   2> 148319 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[34 (1438273682877186048)]} 0 0
[junit4:junit4]   2> 148320 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10034 (1438273682877186049)]} 0 1
[junit4:junit4]   2> 148322 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[34 (1438273682879283200)]} 0 1
[junit4:junit4]   2> 148322 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10034 (1438273682880331776)]} 0 0
[junit4:junit4]   2> 148359 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[35 (1438273682919129088)]} 0 0
[junit4:junit4]   2> 148360 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10035 (1438273682919129089)]} 0 1
[junit4:junit4]   2> 148362 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[35 (1438273682921226240)]} 0 1
[junit4:junit4]   2> 148362 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10035 (1438273682922274816)]} 0 0
[junit4:junit4]   2> 148365 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[24 (-1438273682925420544)]} 0 0
[junit4:junit4]   2> 148365 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10024 (-1438273682925420545)]} 0 0
[junit4:junit4]   2> 148367 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[24 (-1438273682927517696)]} 0 0
[junit4:junit4]   2> 148367 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10024 (-1438273682927517697)]} 0 0
[junit4:junit4]   2> 148369 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[36 (1438273682929614848)]} 0 0
[junit4:junit4]   2> 148370 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10036 (1438273682929614849)]} 0 1
[junit4:junit4]   2> 148372 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[36 (1438273682931712000)]} 0 1
[junit4:junit4]   2> 148372 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10036 (1438273682932760576)]} 0 0
[junit4:junit4]   2> 148378 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[37 (1438273682939052032)]} 0 0
[junit4:junit4]   2> 148379 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10037 (1438273682939052033)]} 0 1
[junit4:junit4]   2> 148380 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[37 (1438273682941149184)]} 0 0
[junit4:junit4]   2> 148381 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10037 (1438273682942197760)]} 0 0
[junit4:junit4]   2> 148412 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[26 (-1438273682973655040)]} 0 1
[junit4:junit4]   2> 148412 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10026 (-1438273682974703616)]} 0 0
[junit4:junit4]   2> 148414 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[26 (-1438273682976800768)]} 0 0
[junit4:junit4]   2> 148414 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10026 (-1438273682976800769)]} 0 0
[junit4:junit4]   2> 148416 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[38 (1438273682978897920)]} 0 0
[junit4:junit4]   2> 148417 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10038 (1438273682978897921)]} 0 1
[junit4:junit4]   2> 148419 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[38 (1438273682982043648)]} 0 0
[junit4:junit4]   2> 148419 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10038 (1438273682982043649)]} 0 0
[junit4:junit4]   2> 148432 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[29 (-1438273682995675136)]} 0 0
[junit4:junit4]   2> 148432 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10029 (-1438273682995675137)]} 0 0
[junit4:junit4]   2> 148435 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[29 (-1438273682998820864)]} 0 1
[junit4:junit4]   2> 148435 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10029 (-1438273682998820865)]} 0 0
[junit4:junit4]   2> 148438 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[39 (1438273683001966592)]} 0 0
[junit4:junit4]   2> 148439 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10039 (1438273683001966593)]} 0 1
[junit4:junit4]   2> 148441 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[39 (1438273683005112320)]} 0 0
[junit4:junit4]   2> 148441 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10039 (1438273683005112321)]} 0 0
[junit4:junit4]   2> 148454 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10040 (1438273683017695232)]} 0 1
[junit4:junit4]   2> 148454 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[40 (1438273683017695233)]} 0 1
[junit4:junit4]   2> 148456 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10040 (1438273683020840960)]} 0 0
[junit4:junit4]   2> 148457 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[40 (1438273683020840961)]} 0 1
[junit4:junit4]   2> 148552 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10041 (1438273683121504256)]} 0 0
[junit4:junit4]   2> 148553 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[41 (1438273683121504257)]} 0 1
[junit4:junit4]   2> 148555 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10041 (1438273683124649984)]} 0 1
[junit4:junit4]   2> 148555 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[41 (1438273683124649985)]} 0 0
[junit4:junit4]   2> 148650 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[42 (1438273683223216129)]} 0 1
[junit4:junit4]   2> 148650 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10042 (1438273683223216128)]} 0 1
[junit4:junit4]   2> 148652 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[42 (1438273683226361856)]} 0 0
[junit4:junit4]   2> 148653 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10042 (1438273683226361857)]} 0 1
[junit4:junit4]   2> 148703 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[43 (1438273683279839232)]} 0 0
[junit4:junit4]   2> 148704 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10043 (1438273683279839233)]} 0 1
[junit4:junit4]   2> 148706 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[43 (1438273683281936384)]} 0 1
[junit4:junit4]   2> 148706 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10043 (1438273683282984960)]} 0 0
[junit4:junit4]   2> 148749 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[30 (-1438273683328073728)]} 0 0
[junit4:junit4]   2> 148750 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10030 (-1438273683329122304)]} 0 0
[junit4:junit4]   2> 148752 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[30 (-1438273683331219456)]} 0 1
[junit4:junit4]   2> 148752 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10030 (-1438273683331219457)]} 0 0
[junit4:junit4]   2> 148754 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[44 (1438273683332268032)]} 0 1
[junit4:junit4]   2> 148754 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10044 (1438273683333316608)]} 0 0
[junit4:junit4]   2> 148756 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[44 (1438273683334365184)]} 0 1
[junit4:junit4]   2> 148756 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10044 (1438273683335413760)]} 0 0
[junit4:junit4]   2> 148821 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[33 (-1438273683403571200)]} 0 0
[junit4:junit4]   2> 148821 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10033 (-1438273683403571201)]} 0 0
[junit4:junit4]   2> 148823 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[33 (-1438273683405668352)]} 0 0
[junit4:junit4]   2> 148823 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10033 (-1438273683405668353)]} 0 0
[junit4:junit4]   2> 148826 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[45 (1438273683407765504)]} 0 1
[junit4:junit4]   2> 148826 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10045 (1438273683408814080)]} 0 0
[junit4:junit4]   2> 148828 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[45 (1438273683410911232)]} 0 0
[junit4:junit4]   2> 148829 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10045 (1438273683410911233)]} 0 1
[junit4:junit4]   2> 148915 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[34 (-1438273683502137344)]} 0 0
[junit4:junit4]   2> 148915 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10034 (-1438273683502137345)]} 0 0
[junit4:junit4]   2> 148917 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[34 (-1438273683504234496)]} 0 0
[junit4:junit4]   2> 148917 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10034 (-1438273683504234497)]} 0 0
[junit4:junit4]   2> 148920 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10046 (1438273683506331648)]} 0 1
[junit4:junit4]   2> 148921 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[46 (1438273683507380224)]} 0 2
[junit4:junit4]   2> 148923 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10046 (1438273683509477376)]} 0 1
[junit4:junit4]   2> 148923 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[46 (1438273683510525952)]} 0 1
[junit4:junit4]   2> 148948 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10035 (-1438273683536740352)]} 0 0
[junit4:junit4]   2> 148949 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[35 (-1438273683537788928)]} 0 1
[junit4:junit4]   2> 148950 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10035 (-1438273683538837504)]} 0 0
[junit4:junit4]   2> 148951 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[35 (-1438273683539886080)]} 0 0
[junit4:junit4]   2> 148953 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10047 (1438273683541983232)]} 0 1
[junit4:junit4]   2> 148953 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[47 (1438273683541983233)]} 0 0
[junit4:junit4]   2> 148956 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10047 (1438273683544080384)]} 0 1
[junit4:junit4]   2> 148956 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[47 (1438273683544080385)]} 0 1
[junit4:junit4]   2> 149048 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10036 (-1438273683641597953)]} 0 0
[junit4:junit4]   2> 149048 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[36 (-1438273683641597952)]} 0 0
[junit4:junit4]   2> 149051 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10036 (-1438273683643695104)]} 0 1
[junit4:junit4]   2> 149051 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[36 (-1438273683644743680)]} 0 0
[junit4:junit4]   2> 149053 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10048 (1438273683646840832)]} 0 0
[junit4:junit4]   2> 149054 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[48 (1438273683646840833)]} 0 1
[junit4:junit4]   2> 149056 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10048 (1438273683648937984)]} 0 1
[junit4:junit4]   2> 149056 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[48 (1438273683649986560)]} 0 0
[junit4:junit4]   2> 149085 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10044 (-1438273683680395264)]} 0 0
[junit4:junit4]   2> 149085 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[44 (-1438273683680395265)]} 0 0
[junit4:junit4]   2> 149087 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10044 (-1438273683682492416)]} 0 0
[junit4:junit4]   2> 149087 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[44 (-1438273683682492417)]} 0 0
[junit4:junit4]   2> 149090 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10049 (1438273683684589568)]} 0 1
[junit4:junit4]   2> 149090 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[49 (1438273683684589569)]} 0 1
[junit4:junit4]   2> 149092 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10049 (1438273683687735296)]} 0 0
[junit4:junit4]   2> 149093 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[49 (1438273683687735297)]} 0 1
[junit4:junit4]   2> 149179 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10045 (-1438273683778961409)]} 0 0
[junit4:junit4]   2> 149179 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[45 (-1438273683778961408)]} 0 0
[junit4:junit4]   2> 149181 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10045 (-1438273683781058560)]} 0 0
[junit4:junit4]   2> 149181 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[45 (-1438273683781058561)]} 0 0
[junit4:junit4]   2> 149184 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10050 (1438273683783155712)]} 0 1
[junit4:junit4]   2> 149185 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[50 (1438273683784204288)]} 0 1
[junit4:junit4]   2> 149187 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10050 (1438273683787350016)]} 0 0
[junit4:junit4]   2> 149188 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[50 (1438273683787350017)]} 0 1
[junit4:junit4]   2> 149196 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10049 (-1438273683796787200)]} 0 0
[junit4:junit4]   2> 149196 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[49 (-1438273683796787201)]} 0 0
[junit4:junit4]   2> 149198 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10049 (-1438273683798884352)]} 0 0
[junit4:junit4]   2> 149199 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[49 (-1438273683799932928)]} 0 0
[junit4:junit4]   2> 149201 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10051 (1438273683800981504)]} 0 1
[junit4:junit4]   2> 149201 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[51 (1438273683802030080)]} 0 0
[junit4:junit4]   2> 149203 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10051 (1438273683804127232)]} 0 0
[junit4:junit4]   2> 149204 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[51 (1438273683804127233)]} 0 1
[junit4:junit4]   2> 149259 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10051 (-1438273683861798912)]} 0 1
[junit4:junit4]   2> 149259 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[51 (-1438273683862847488)]} 0 0
[junit4:junit4]   2> 149261 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10051 (-1438273683864944640)]} 0 0
[junit4:junit4]   2> 149261 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[51 (-1438273683864944641)]} 0 0
[junit4:junit4]   2> 149263 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10052 (1438273683867041792)]} 0 0
[junit4:junit4]   2> 149264 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[52 (1438273683867041793)]} 0 1
[junit4:junit4]   2> 149266 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10052 (1438273683869138944)]} 0 1
[junit4:junit4]   2> 149266 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[52 (1438273683870187520)]} 0 0
[junit4:junit4]   2> 149340 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10053 (1438273683946733568)]} 0 1
[junit4:junit4]   2> 149340 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[53 (1438273683946733569)]} 0 1
[junit4:junit4]   2> 149342 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10053 (1438273683949879296)]} 0 0
[junit4:junit4]   2> 149343 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[53 (1438273683949879297)]} 0 1
[junit4:junit4]   2> 149430 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10054 (1438273684041105408)]} 0 1
[junit4:junit4]   2> 149430 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[54 (1438273684042153984)]} 0 0
[junit4:junit4]   2> 149433 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10054 (1438273684044251136)]} 0 1
[junit4:junit4]   2> 149434 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[54 (1438273684045299712)]} 0 2
[junit4:junit4]   2> 149500 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10055 (1438273684115554304)]} 0 0
[junit4:junit4]   2> 149500 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[55 (1438273684115554305)]} 0 0
[junit4:junit4]   2> 149502 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10055 (1438273684117651456)]} 0 0
[junit4:junit4]   2> 149503 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[55 (1438273684118700032)]} 0 0
[junit4:junit4]   2> 149522 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10056 (1438273684138622976)]} 0 0
[junit4:junit4]   2> 149523 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[56 (1438273684138622977)]} 0 1
[junit4:junit4]   2> 149525 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10056 (1438273684141768704)]} 0 1
[junit4:junit4]   2> 149525 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[56 (1438273684141768705)]} 0 0
[junit4:junit4]   2> 149558 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10057 (1438273684175323136)]} 0 1
[junit4:junit4]   2> 149558 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[57 (1438273684175323137)]} 0 1
[junit4:junit4]   2> 149560 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10057 (1438273684178468864)]} 0 0
[junit4:junit4]   2> 149561 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[57 (1438273684178468865)]} 0 1
[junit4:junit4]   2> 149577 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[58 (1438273684196294657)]} 0 0
[junit4:junit4]   2> 149578 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10058 (1438273684196294656)]} 0 1
[junit4:junit4]   2> 149580 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[58 (1438273684198391808)]} 0 1
[junit4:junit4]   2> 149580 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10058 (1438273684199440384)]} 0 0
[junit4:junit4]   2> 149629 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[59 (1438273684249772032)]} 0 1
[junit4:junit4]   2> 149629 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10059 (1438273684250820608)]} 0 0
[junit4:junit4]   2> 149631 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[59 (1438273684252917760)]} 0 1
[junit4:junit4]   2> 149632 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10059 (1438273684252917761)]} 0 1
[junit4:junit4]   2> 149675 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[60 (1438273684298006528)]} 0 1
[junit4:junit4]   2> 149675 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10060 (1438273684299055104)]} 0 0
[junit4:junit4]   2> 149678 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[60 (1438273684301152256)]} 0 1
[junit4:junit4]   2> 149678 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10060 (1438273684301152257)]} 0 1
[junit4:junit4]   2> 149710 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[61 (1438273684335755264)]} 0 0
[junit4:junit4]   2> 149711 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10061 (1438273684335755265)]} 0 1
[junit4:junit4]   2> 149713 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[61 (1438273684337852416)]} 0 1
[junit4:junit4]   2> 149713 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10061 (1438273684338900992)]} 0 0
[junit4:junit4]   2> 149801 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[52 (-1438273684431175680)]} 0 0
[junit4:junit4]   2> 149802 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10052 (-1438273684432224256)]} 0 1
[junit4:junit4]   2> 149803 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[52 (-1438273684433272832)]} 0 0
[junit4:junit4]   2> 149804 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10052 (-1438273684434321408)]} 0 1
[junit4:junit4]   2> 149806 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[62 (1438273684435369984)]} 0 1
[junit4:junit4]   2> 149806 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10062 (1438273684436418560)]} 0 0
[junit4:junit4]   2> 149809 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[62 (1438273684438515712)]} 0 1
[junit4:junit4]   2> 149809 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10062 (1438273684438515713)]} 0 1
[junit4:junit4]   2> 149829 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10057 (-1438273684460535808)]} 0 0
[junit4:junit4]   2> 149829 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[57 (-1438273684460535809)]} 0 0
[junit4:junit4]   2> 149831 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10057 (-1438273684462632960)]} 0 0
[junit4:junit4]   2> 149831 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[57 (-1438273684462632961)]} 0 0
[junit4:junit4]   2> 149833 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10063 (1438273684464730112)]} 0 0
[junit4:junit4]   2> 149834 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[63 (1438273684465778688)]} 0 0
[junit4:junit4]   2> 149836 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10063 (1438273684466827264)]} 0 1
[junit4:junit4]   2> 149836 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[63 (1438273684467875840)]} 0 0
[junit4:junit4]   2> 149870 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10064 (1438273684503527424)]} 0 0
[junit4:junit4]   2> 149871 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[64 (1438273684503527425)]} 0 1
[junit4:junit4]   2> 149873 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10064 (1438273684505624576)]} 0 1
[junit4:junit4]   2> 149875 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[64 (1438273684506673152)]} 0 2
[junit4:junit4]   2> 149904 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10065 (1438273684539179008)]} 0 0
[junit4:junit4]   2> 149906 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[65 (1438273684541276160)]} 0 0
[junit4:junit4]   2> 149907 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10065 (1438273684541276160)]} 0 1
[junit4:junit4]   2> 149909 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[65 (1438273684543373312)]} 0 1
[junit4:junit4]   2> 149911 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10058 (-1438273684546519040)]} 0 0
[junit4:junit4]   2> 149913 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10058 (-1438273684548616192)]} 0 1
[junit4:junit4]   2> 149913 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[58 (-1438273684548616192)]} 0 0
[junit4:junit4]   2> 149915 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[58 (-1438273684550713344)]} 0 0
[junit4:junit4]   2> 149915 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10066 (1438273684550713344)]} 0 1
[junit4:junit4]   2> 149917 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[66 (1438273684552810496)]} 0 0
[junit4:junit4]   2> 149918 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10066 (1438273684552810496)]} 0 1
[junit4:junit4]   2> 149920 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[66 (1438273684555956224)]} 0 0
[junit4:junit4]   2> 149938 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10067 (1438273684573782016)]} 0 1
[junit4:junit4]   2> 149940 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[67 (1438273684575879168)]} 0 1
[junit4:junit4]   2> 149940 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10067 (1438273684575879168)]} 0 1
[junit4:junit4]   2> 149942 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[67 (1438273684579024896)]} 0 1
[junit4:junit4]   2> 149981 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10068 (1438273684618870784)]} 0 1
[junit4:junit4]   2> 149982 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[68 (1438273684620967936)]} 0 0
[junit4:junit4]   2> 149983 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10068 (1438273684622016512)]} 0 0
[junit4:junit4]   2> 149985 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[68 (1438273684623065088)]} 0 1
[junit4:junit4]   2> 149988 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10059 (-1438273684627259392)]} 0 0
[junit4:junit4]   2> 149990 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[59 (-1438273684629356544)]} 0 0
[junit4:junit4]   2> 149990 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10059 (-1438273684629356544)]} 0 0
[junit4:junit4]   2> 149992 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[59 (-1438273684631453696)]} 0 0
[junit4:junit4]   2> 149993 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10069 (1438273684631453696)]} 0 1
[junit4:junit4]   2> 149994 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[69 (1438273684633550848)]} 0 0
[junit4:junit4]   2> 149995 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10069 (1438273684634599424)]} 0 0
[junit4:junit4]   2> 149996 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[69 (1438273684635648000)]} 0 0
[junit4:junit4]   2> 150002 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10070 (1438273684641939456)]} 0 0
[junit4:junit4]   2> 150004 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[70 (1438273684642988032)]} 0 1
[junit4:junit4]   2> 150004 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10070 (1438273684644036608)]} 0 0
[junit4:junit4]   2> 150006 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[70 (1438273684646133760)]} 0 0
[junit4:junit4]   2> 150071 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10063 (-1438273684714291200)]} 0 1
[junit4:junit4]   2> 150072 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[63 (-1438273684715339776)]} 0 0
[junit4:junit4]   2> 150073 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10063 (-1438273684716388352)]} 0 0
[junit4:junit4]   2> 150074 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[63 (-1438273684717436928)]} 0 0
[junit4:junit4]   2> 150075 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10071 (1438273684718485504)]} 0 0
[junit4:junit4]   2> 150077 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[71 (1438273684719534080)]} 0 1
[junit4:junit4]   2> 150077 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10071 (1438273684720582656)]} 0 0
[junit4:junit4]   2> 150079 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[71 (1438273684722679808)]} 0 0
[junit4:junit4]   2> 150170 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10067 (-1438273684818100224)]} 0 0
[junit4:junit4]   2> 150172 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[67 (-1438273684820197376)]} 0 0
[junit4:junit4]   2> 150173 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10067 (-1438273684821245952)]} 0 0
[junit4:junit4]   2> 150174 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[67 (-1438273684822294528)]} 0 0
[junit4:junit4]   2> 150175 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10072 (1438273684823343104)]} 0 1
[junit4:junit4]   2> 150176 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[72 (1438273684824391680)]} 0 0
[junit4:junit4]   2> 150177 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10072 (1438273684825440256)]} 0 0
[junit4:junit4]   2> 150179 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[72 (1438273684826488832)]} 0 1
[junit4:junit4]   2> 150208 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10073 (1438273684857946112)]} 0 0
[junit4:junit4]   2> 150209 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[73 (1438273684858994688)]} 0 1
[junit4:junit4]   2> 150210 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10073 (1438273684860043264)]} 0 0
[junit4:junit4]   2> 150211 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[73 (1438273684861091840)]} 0 0
[junit4:junit4]   2> 150243 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10074 (1438273684894646272)]} 0 0
[junit4:junit4]   2> 150244 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[74 (1438273684894646273)]} 0 1
[junit4:junit4]   2> 150246 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10074 (1438273684896743424)]} 0 1
[junit4:junit4]   2> 150246 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[74 (1438273684897792000)]} 0 0
[junit4:junit4]   2> 150259 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10075 (1438273684911423488)]} 0 0
[junit4:junit4]   2> 150260 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[75 (1438273684912472064)]} 0 1
[junit4:junit4]   2> 150262 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10075 (1438273684914569216)]} 0 1
[junit4:junit4]   2> 150262 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[75 (1438273684914569217)]} 0 0
[junit4:junit4]   2> 150352 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[76 (1438273685007892480)]} 0 1
[junit4:junit4]   2> 150352 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10076 (1438273685007892481)]} 0 1
[junit4:junit4]   2> 150354 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[76 (1438273685011038208)]} 0 0
[junit4:junit4]   2> 150354 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10076 (1438273685011038209)]} 0 0
[junit4:junit4]   2> 150455 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[77 (1438273685115895808)]} 0 1
[junit4:junit4]   2> 150455 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10077 (1438273685115895809)]} 0 1
[junit4:junit4]   2> 150457 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[77 (1438273685119041536)]} 0 0
[junit4:junit4]   2> 150458 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10077 (1438273685119041537)]} 0 1
[junit4:junit4]   2> 150461 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[68 (-1438273685123235840)]} 0 0
[junit4:junit4]   2> 150462 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10068 (-1438273685124284416)]} 0 0
[junit4:junit4]   2> 150463 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[68 (-1438273685125332992)]} 0 0
[junit4:junit4]   2> 150464 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10068 (-1438273685126381568)]} 0 0
[junit4:junit4]   2> 150466 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[78 (1438273685127430144)]} 0 1
[junit4:junit4]   2> 150466 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10078 (1438273685128478720)]} 0 1
[junit4:junit4]   2> 150468 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[78 (1438273685129527296)]} 0 1
[junit4:junit4]   2> 150468 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10078 (1438273685130575872)]} 0 0
[junit4:junit4]   2> 150471 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[70 (-1438273685133721600)]} 0 0
[junit4:junit4]   2> 150471 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10070 (-1438273685133721601)]} 0 0
[junit4:junit4]   2> 150473 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[70 (-1438273685135818752)]} 0 0
[junit4:junit4]   2> 150473 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10070 (-1438273685135818753)]} 0 0
[junit4:junit4]   2> 150475 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[79 (1438273685137915904)]} 0 0
[junit4:junit4]   2> 150476 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10079 (1438273685137915905)]} 0 1
[junit4:junit4]   2> 150477 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[79 (1438273685140013056)]} 0 0
[junit4:junit4]   2> 150478 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10079 (1438273685141061632)]} 0 0
[junit4:junit4]   2> 150512 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[80 (1438273685176713216)]} 0 1
[junit4:junit4]   2> 150513 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10080 (1438273685176713217)]} 0 1
[junit4:junit4]   2> 150515 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[80 (1438273685178810368)]} 0 1
[junit4:junit4]   2> 150515 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10080 (1438273685179858944)]} 0 1
[junit4:junit4]   2> 150523 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[81 (1438273685188247552)]} 0 0
[junit4:junit4]   2> 150524 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10081 (1438273685188247553)]} 0 1
[junit4:junit4]   2> 150526 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[81 (1438273685190344704)]} 0 1
[junit4:junit4]   2> 150526 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10081 (1438273685191393280)]} 0 0
[junit4:junit4]   2> 150625 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[82 (1438273685294153728)]} 0 1
[junit4:junit4]   2> 150625 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10082 (1438273685294153729)]} 0 1
[junit4:junit4]   2> 150627 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[82 (1438273685297299456)]} 0 0
[junit4:junit4]   2> 150628 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10082 (1438273685297299457)]} 0 1
[junit4:junit4]   2> 150666 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[83 (1438273685338193920)]} 0 1
[junit4:junit4]   2> 150666 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10083 (1438273685338193921)]} 0 0
[junit4:junit4]   2> 150669 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[83 (1438273685340291072)]} 0 1
[junit4:junit4]   2> 150669 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10083 (1438273685341339648)]} 0 1
[junit4:junit4]   2> 150731 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[84 (1438273685406351360)]} 0 0
[junit4:junit4]   2> 150732 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10084 (1438273685406351361)]} 0 1
[junit4:junit4]   2> 150734 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[84 (1438273685409497088)]} 0 1
[junit4:junit4]   2> 150734 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10084 (1438273685409497089)]} 0 0
[junit4:junit4]   2> 150824 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10085 (1438273685502820353)]} 0 1
[junit4:junit4]   2> 150824 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[85 (1438273685502820352)]} 0 1
[junit4:junit4]   2> 150826 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10085 (1438273685505966080)]} 0 0
[junit4:junit4]   2> 150827 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[85 (1438273685505966081)]} 0 1
[junit4:junit4]   2> 150919 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[86 (1438273685603483648)]} 0 0
[junit4:junit4]   2> 150919 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10086 (1438273685603483649)]} 0 0
[junit4:junit4]   2> 150922 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[86 (1438273685605580800)]} 0 1
[junit4:junit4]   2> 150922 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10086 (1438273685606629376)]} 0 1
[junit4:junit4]   2> 150941 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[72 (-1438273685626552320)]} 0 0
[junit4:junit4]   2> 150941 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10072 (-1438273685626552321)]} 0 0
[junit4:junit4]   2> 150943 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[72 (-1438273685628649472)]} 0 0
[junit4:junit4]   2> 150944 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10072 (-1438273685629698048)]} 0 1
[junit4:junit4]   2> 150945 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[87 (1438273685630746624)]} 0 0
[junit4:junit4]   2> 150946 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10087 (1438273685631795200)]} 0 1
[junit4:junit4]   2> 150948 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[87 (1438273685632843776)]} 0 1
[junit4:junit4]   2> 150948 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10087 (1438273685633892352)]} 0 0
[junit4:junit4]   2> 151041 T692 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[74 (-1438273685731409920)]} 0 0
[junit4:junit4]   2> 151041 T690 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10074 (-1438273685731409921)]} 0 0
[junit4:junit4]   2> 151043 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[74 (-1438273685733507072)]} 0 0
[junit4:junit4]   2> 151044 T710 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10074 (-1438273685733507073)]} 0 1
[junit4:junit4]   2> 151046 T691 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[88 (1438273685735604224)]} 0 1
[junit4:junit4]   2> 151046 T693 C263 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10088 (1438273685736652800)]} 0 0
[junit4:junit4]   2> 151048 T713 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[88 (1438273685738749952)]} 0 0
[junit4:junit4]   2> 151049 T711 C264 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10088 (1438273685738749953)]} 0 1
[junit4:junit4]   2> ASYNC  NEW_CORE C265 name=collection1 org.apache.solr.core.SolrCore@1b1866aa url=http://127.0.0.1:33152/wu_z/collection1 node=127.0.0.1:33152_wu_z C265_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:33152_wu_z, base_url=http://127.0.0.1:33152/wu_z, leader=true}
[junit4:junit4]   2> 151063 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[75 (-1438273685754478592)]} 0 0
[junit4:junit4]   2> 151064 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10075 (-1438273685755527168)]} 0 0
[junit4:junit4]   2> ASYNC  NEW_CORE C266 name=collection1 org.apache.solr.core.SolrCore@1afe084a url=http://127.0.0.1:50898/wu_z/collection1 node=127.0.0.1:50898_wu_z C266_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50898_wu_z, base_url=http://127.0.0.1:50898/wu_z, leader=true}
[junit4:junit4]   2> 151065 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[75 (-1438273685756575744)]} 0 0
[junit4:junit4]   2> 151066 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10075 (-1438273685757624320)]} 0 0
[junit4:junit4]   2> 151068 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[89 (1438273685759721472)]} 0 0
[junit4:junit4]   2> 151069 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10089 (1438273685759721473)]} 0 1
[junit4:junit4]   2> 151071 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[89 (1438273685761818624)]} 0 1
[junit4:junit4]   2> 151071 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10089 (1438273685762867200)]} 0 0
[junit4:junit4]   2> 151095 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[90 (1438273685786984448)]} 0 1
[junit4:junit4]   2> 151095 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10090 (1438273685786984449)]} 0 1
[junit4:junit4]   2> 151097 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[90 (1438273685790130176)]} 0 0
[junit4:junit4]   2> 151098 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10090 (1438273685790130177)]} 0 1
[junit4:junit4]   2> 151144 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[91 (1438273685839413248)]} 0 1
[junit4:junit4]   2> 151145 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10091 (1438273685839413249)]} 0 1
[junit4:junit4]   2> 151147 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[91 (1438273685841510400)]} 0 1
[junit4:junit4]   2> 151147 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10091 (1438273685842558976)]} 0 0
[junit4:junit4]   2> 151243 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[92 (1438273685942173696)]} 0 1
[junit4:junit4]   2> 151244 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10092 (1438273685943222272)]} 0 2
[junit4:junit4]   2> 151246 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[92 (1438273685945319424)]} 0 1
[junit4:junit4]   2> 151246 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10092 (1438273685946368000)]} 0 0
[junit4:junit4]   2> 151315 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[81 (-1438273686018719744)]} 0 0
[junit4:junit4]   2> 151315 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10081 (-1438273686018719745)]} 0 0
[junit4:junit4]   2> 151318 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[81 (-1438273686020816896)]} 0 1
[junit4:junit4]   2> 151318 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10081 (-1438273686021865472)]} 0 0
[junit4:junit4]   2> 151320 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[93 (1438273686023962624)]} 0 0
[junit4:junit4]   2> 151321 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10093 (1438273686023962625)]} 0 1
[junit4:junit4]   2> 151323 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[93 (1438273686026059776)]} 0 1
[junit4:junit4]   2> 151323 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10093 (1438273686027108352)]} 0 1
[junit4:junit4]   2> 151350 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[84 (-1438273686055419904)]} 0 0
[junit4:junit4]   2> 151350 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10084 (-1438273686055419905)]} 0 0
[junit4:junit4]   2> 151352 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[84 (-1438273686057517056)]} 0 0
[junit4:junit4]   2> 151352 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10084 (-1438273686057517057)]} 0 0
[junit4:junit4]   2> 151355 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[94 (1438273686059614208)]} 0 1
[junit4:junit4]   2> 151355 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10094 (1438273686059614209)]} 0 1
[junit4:junit4]   2> 151357 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[94 (1438273686062759936)]} 0 0
[junit4:junit4]   2> 151358 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10094 (1438273686062759937)]} 0 1
[junit4:junit4]   2> 151397 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10088 (-1438273686104702976)]} 0 0
[junit4:junit4]   2> 151397 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[88 (-1438273686104702977)]} 0 0
[junit4:junit4]   2> 151399 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10088 (-1438273686106800128)]} 0 0
[junit4:junit4]   2> 151399 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[88 (-1438273686106800129)]} 0 0
[junit4:junit4]   2> 151401 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10095 (1438273686108897280)]} 0 0
[junit4:junit4]   2> 151402 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[95 (1438273686108897281)]} 0 1
[junit4:junit4]   2> 151404 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10095 (1438273686110994432)]} 0 1
[junit4:junit4]   2> 151404 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[95 (1438273686112043008)]} 0 0
[junit4:junit4]   2> 151428 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10096 (1438273686137208832)]} 0 1
[junit4:junit4]   2> 151434 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10096 (1438273686142451712)]} 0 1
[junit4:junit4]   2> 151435 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[96 (1438273686143500288)]} 0 1
[junit4:junit4]   2> 151437 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[96 (1438273686146646016)]} 0 0
[junit4:junit4]   2> 151465 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10097 (1438273686176006144)]} 0 1
[junit4:junit4]   2> 151468 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10097 (1438273686178103296)]} 0 1
[junit4:junit4]   2> 151468 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[97 (1438273686178103296)]} 0 1
[junit4:junit4]   2> 151470 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[97 (1438273686181249024)]} 0 0
[junit4:junit4]   2> 151512 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10098 (1438273686225289216)]} 0 0
[junit4:junit4]   2> 151514 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[98 (1438273686227386368)]} 0 0
[junit4:junit4]   2> 151515 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10098 (1438273686227386368)]} 0 1
[junit4:junit4]   2> 151517 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[98 (1438273686229483520)]} 0 1
[junit4:junit4]   2> 151556 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10099 (1438273686271426560)]} 0 0
[junit4:junit4]   2> 151558 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[99 (1438273686273523712)]} 0 1
[junit4:junit4]   2> 151559 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10099 (1438273686273523712)]} 0 1
[junit4:junit4]   2> 151560 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[99 (1438273686275620864)]} 0 0
[junit4:junit4]   2> 151656 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10100 (1438273686376284160)]} 0 0
[junit4:junit4]   2> 151657 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[100 (1438273686377332736)]} 0 0
[junit4:junit4]   2> 151659 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10100 (1438273686379429888)]} 0 1
[junit4:junit4]   2> 151660 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[100 (1438273686379429889)]} 0 1
[junit4:junit4]   2> 151702 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10101 (1438273686423470080)]} 0 1
[junit4:junit4]   2> 151702 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[101 (1438273686424518656)]} 0 0
[junit4:junit4]   2> 151704 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10101 (1438273686426615808)]} 0 0
[junit4:junit4]   2> 151705 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[101 (1438273686426615809)]} 0 1
[junit4:junit4]   2> 151762 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10089 (-1438273686487433216)]} 0 0
[junit4:junit4]   2> 151762 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[89 (-1438273686487433217)]} 0 0
[junit4:junit4]   2> 151764 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10089 (-1438273686489530368)]} 0 0
[junit4:junit4]   2> 151764 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[89 (-1438273686489530369)]} 0 0
[junit4:junit4]   2> 151766 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10102 (1438273686491627520)]} 0 0
[junit4:junit4]   2> 151767 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[102 (1438273686491627521)]} 0 1
[junit4:junit4]   2> 151769 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10102 (1438273686493724672)]} 0 1
[junit4:junit4]   2> 151769 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[102 (1438273686494773248)]} 0 1
[junit4:junit4]   2> 151826 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10103 (1438273686554542080)]} 0 0
[junit4:junit4]   2> 151827 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[103 (1438273686554542081)]} 0 1
[junit4:junit4]   2> 151829 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10103 (1438273686557687808)]} 0 0
[junit4:junit4]   2> 151830 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[103 (1438273686557687809)]} 0 1
[junit4:junit4]   2> 151928 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[104 (1438273686661496832)]} 0 0
[junit4:junit4]   2> 151928 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10104 (1438273686661496833)]} 0 0
[junit4:junit4]   2> 151931 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[104 (1438273686664642560)]} 0 0
[junit4:junit4]   2> 151931 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10104 (1438273686664642561)]} 0 0
[junit4:junit4]   2> 152014 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[105 (1438273686750625792)]} 0 1
[junit4:junit4]   2> 152014 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10105 (1438273686751674368)]} 0 0
[junit4:junit4]   2> 152017 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[105 (1438273686753771520)]} 0 1
[junit4:junit4]   2> 152017 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10105 (1438273686753771521)]} 0 1
[junit4:junit4]   2> 152057 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[90 (-1438273686796763136)]} 0 0
[junit4:junit4]   2> 152057 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10090 (-1438273686796763137)]} 0 0
[junit4:junit4]   2> 152059 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[90 (-1438273686798860288)]} 0 0
[junit4:junit4]   2> 152060 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10090 (-1438273686799908864)]} 0 0
[junit4:junit4]   2> 152062 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[106 (1438273686800957440)]} 0 1
[junit4:junit4]   2> 152062 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10106 (1438273686800957441)]} 0 1
[junit4:junit4]   2> 152064 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[106 (1438273686804103168)]} 0 0
[junit4:junit4]   2> 152064 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10106 (1438273686804103169)]} 0 0
[junit4:junit4]   2> 152108 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10092 (-1438273686850240512)]} 0 0
[junit4:junit4]   2> 152108 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[92 (-1438273686850240513)]} 0 0
[junit4:junit4]   2> 152110 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10092 (-1438273686852337664)]} 0 0
[junit4:junit4]   2> 152111 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[92 (-1438273686853386240)]} 0 0
[junit4:junit4]   2> 152113 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10107 (1438273686854434816)]} 0 1
[junit4:junit4]   2> 152113 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[107 (1438273686855483392)]} 0 0
[junit4:junit4]   2> 152115 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10107 (1438273686857580544)]} 0 0
[junit4:junit4]   2> 152116 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[107 (1438273686857580545)]} 0 1
[junit4:junit4]   2> 152141 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10099 (-1438273686884843520)]} 0 0
[junit4:junit4]   2> 152141 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[99 (-1438273686884843521)]} 0 0
[junit4:junit4]   2> 152144 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10099 (-1438273686886940672)]} 0 1
[junit4:junit4]   2> 152144 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[99 (-1438273686887989248)]} 0 0
[junit4:junit4]   2> 152146 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10108 (1438273686890086400)]} 0 1
[junit4:junit4]   2> 152146 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[108 (1438273686890086401)]} 0 0
[junit4:junit4]   2> 152148 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10108 (1438273686892183552)]} 0 0
[junit4:junit4]   2> 152149 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[108 (1438273686892183553)]} 0 1
[junit4:junit4]   2> 152212 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10109 (1438273686959292416)]} 0 1
[junit4:junit4]   2> 152212 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[109 (1438273686959292417)]} 0 0
[junit4:junit4]   2> 152214 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10109 (1438273686961389568)]} 0 0
[junit4:junit4]   2> 152215 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[109 (1438273686961389569)]} 0 1
[junit4:junit4]   2> 152266 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[102 (-1438273687014866944)]} 0 1
[junit4:junit4]   2> 152266 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10102 (-1438273687014866945)]} 0 1
[junit4:junit4]   2> 152268 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[102 (-1438273687018012672)]} 0 0
[junit4:junit4]   2> 152268 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10102 (-1438273687018012673)]} 0 0
[junit4:junit4]   2> 152270 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[110 (1438273687020109824)]} 0 1
[junit4:junit4]   2> 152270 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10110 (1438273687020109825)]} 0 0
[junit4:junit4]   2> 152272 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[110 (1438273687022206976)]} 0 0
[junit4:junit4]   2> 152273 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10110 (1438273687022206977)]} 0 1
[junit4:junit4]   2> 152286 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[106 (-1438273687036887040)]} 0 0
[junit4:junit4]   2> 152287 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10106 (-1438273687037935616)]} 0 1
[junit4:junit4]   2> 152289 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[106 (-1438273687040032768)]} 0 1
[junit4:junit4]   2> 152289 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10106 (-1438273687040032769)]} 0 0
[junit4:junit4]   2> 152291 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[111 (1438273687042129920)]} 0 1
[junit4:junit4]   2> 152291 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10111 (1438273687042129921)]} 0 0
[junit4:junit4]   2> 152293 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[111 (1438273687044227072)]} 0 0
[junit4:junit4]   2> 152294 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10111 (1438273687044227073)]} 0 1
[junit4:junit4]   2> 152340 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[107 (-1438273687092461568)]} 0 1
[junit4:junit4]   2> 152340 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10107 (-1438273687093510144)]} 0 0
[junit4:junit4]   2> 152342 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[107 (-1438273687095607296)]} 0 1
[junit4:junit4]   2> 152342 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10107 (-1438273687095607297)]} 0 0
[junit4:junit4]   2> 152344 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[112 (1438273687097704448)]} 0 1
[junit4:junit4]   2> 152344 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10112 (1438273687097704449)]} 0 0
[junit4:junit4]   2> 152346 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[112 (1438273687099801600)]} 0 0
[junit4:junit4]   2> 152346 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10112 (1438273687099801601)]} 0 0
[junit4:junit4]   2> 152393 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[113 (1438273687148036096)]} 0 1
[junit4:junit4]   2> 152393 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10113 (1438273687148036097)]} 0 1
[junit4:junit4]   2> 152395 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[113 (1438273687151181824)]} 0 0
[junit4:junit4]   2> 152395 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10113 (1438273687151181825)]} 0 0
[junit4:junit4]   2> 152453 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[109 (-1438273687211999232)]} 0 0
[junit4:junit4]   2> 152453 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10109 (-1438273687211999233)]} 0 0
[junit4:junit4]   2> 152455 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[109 (-1438273687214096384)]} 0 0
[junit4:junit4]   2> 152455 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10109 (-1438273687214096385)]} 0 0
[junit4:junit4]   2> 152458 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[114 (1438273687216193536)]} 0 1
[junit4:junit4]   2> 152458 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10114 (1438273687216193537)]} 0 1
[junit4:junit4]   2> 152460 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[114 (1438273687219339264)]} 0 0
[junit4:junit4]   2> 152460 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10114 (1438273687219339265)]} 0 0
[junit4:junit4]   2> 152527 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[115 (1438273687288545280)]} 0 1
[junit4:junit4]   2> 152527 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10115 (1438273687288545281)]} 0 1
[junit4:junit4]   2> 152529 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[115 (1438273687291691008)]} 0 0
[junit4:junit4]   2> 152529 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10115 (1438273687291691009)]} 0 0
[junit4:junit4]   2> 152586 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10116 (1438273687350411264)]} 0 1
[junit4:junit4]   2> 152586 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[116 (1438273687350411265)]} 0 1
[junit4:junit4]   2> 152588 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10116 (1438273687353556992)]} 0 0
[junit4:junit4]   2> 152589 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[116 (1438273687353556993)]} 0 1
[junit4:junit4]   2> 152610 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10117 (1438273687376625664)]} 0 0
[junit4:junit4]   2> 152611 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[117 (1438273687376625665)]} 0 1
[junit4:junit4]   2> 152612 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10117 (1438273687378722816)]} 0 0
[junit4:junit4]   2> 152613 T711 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[117 (1438273687379771392)]} 0 0
[junit4:junit4]   2> 152650 T691 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10111 (-1438273687417520128)]} 0 1
[junit4:junit4]   2> 152650 T690 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[111 (-1438273687418568704)]} 0 0
[junit4:junit4]   2> 152652 T710 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[10111 (-1438273687420665856)]} 0 1
[junit4:junit4]   2> 152652 T713 C266 P50898 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {delete=[111 (-1438273687420665857)]} 0 0
[junit4:junit4]   2> 152654 T692 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[10118 (1438273687422763008)]} 0 0
[junit4:junit4]   2> 152654 T693 C265 P33152 oasup.LogUpdateProcessor.finish [collection1] webapp=/wu_z path=/update params={wt=javabin&version=2} {add=[118 (1438273687422763009)]} 0 0
[junit4:junit4]   2> 152656 T711 C266 P50898 oasup

[...truncated too long message...]

]   2> 		... 1 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 364997 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 364999 T752 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 365000 T752 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 365001 T752 oasc.Overseer.start Overseer (id=89892104415346698-127.0.0.1:57762_wu_z-n_0000000003) starting
[junit4:junit4]   2> 365003 T789 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 365004 T788 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 365005 T788 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 365005 T788 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50898_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50898/wu_z"}
[junit4:junit4]   2> 365007 T788 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50898_wu_z",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50898/wu_z"}
[junit4:junit4]   2> 365014 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 365047 T675 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57762
[junit4:junit4]   2> 365048 T675 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=451494795
[junit4:junit4]   2> 365179 T697 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 365180 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 365180 T697 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 366049 T675 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 366049 T675 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 366050 T675 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1b15ab37
[junit4:junit4]   2> 366059 T675 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=43,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=60,cumulative_deletesById=22,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 366059 T675 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 366059 T675 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 366060 T675 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 366062 T675 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 366063 T675 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 366063 T675 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2;done=false>>]
[junit4:junit4]   2> 366064 T675 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2
[junit4:junit4]   2> 366064 T675 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/index;done=false>>]
[junit4:junit4]   2> 366064 T675 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371644659656/jetty2/index
[junit4:junit4]   2> 366065 T788 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89892104415346698-127.0.0.1:57762_wu_z-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 366065 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 366065 T752 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 366066 T752 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 366086 T675 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/wu_z,null}
[junit4:junit4]   2> 366142 T675 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   2> 366143 T675 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45749 45749
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> safe stop:
[junit4:junit4]   1> safe stop:
[junit4:junit4]   1> safe stop:
[junit4:junit4]   1> safe stop:
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RecoveryZkTest -Dtests.method=testDistribSearch -Dtests.seed=A51E79EAB8B31674 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_YE -Dtests.timezone=Indian/Mayotte -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  230s J0 | RecoveryZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: expected:<2352> but was:<60>
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([A51E79EAB8B31674:24F8F7F2CFEC7648]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 366226 T675 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 229601 T674 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 366266 T396 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=SimpleText), text=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=SimpleText), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=SimpleText), id=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=SimpleText), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=Pulsing41(freqCutoff=5 minBlockSize=38 maxBlockSize=74), other_tl1=PostingsFormat(name=SimpleText), multiDefault=Pulsing41(freqCutoff=5 minBlockSize=38 maxBlockSize=74), a_si=Pulsing41(freqCutoff=5 minBlockSize=38 maxBlockSize=74)}, docValues:{}, sim=DefaultSimilarity, locale=ar_YE, timezone=Indian/Mayotte
[junit4:junit4]   2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.6.0_37 (32-bit)/cpus=8,threads=3,free=85262568,total=167002112
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TermVectorComponentTest, TestFaceting, TestQuerySenderListener, TestPhraseSuggestions, StatelessScriptUpdateProcessorFactoryTest, SpellingQueryConverterTest, DateFieldTest, TestLFUCache, TestTrie, TestPerFieldSimilarity, TestXIncludeConfig, SoftAutoCommitTest, OverseerTest, TestFastWriter, SpatialFilterTest, TestPseudoReturnFields, TestCloudManagedSchema, TestPluginEnable, RecoveryZkTest]
[junit4:junit4] Completed on J0 in 230.68s, 1 test, 1 failure <<< FAILURES!

[...truncated 753 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:392: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:372: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1246: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:890: There were test failures: 298 suites, 1253 tests, 1 failure, 14 ignored (8 assumptions)

Total time: 61 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jrockit-jdk1.6.0_37-R28.2.5-4.1.0 -XnoOpt
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure