You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/27 04:12:02 UTC

[JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.6.0_45) - Build # 2933 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2933/
Java: 64bit/jdk1.6.0_45 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:53034/kweo/q/collection1lastClient and got 247 from http://127.0.0.1:53053/kweo/q/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:53034/kweo/q/collection1lastClient and got 247 from http://127.0.0.1:53053/kweo/q/collection1
	at __randomizedtesting.SeedInfo.seed([40763C2288D25CE0:C190B23AFF8D3CDC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 9115 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 786772 T2026 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /kweo/q
[junit4:junit4]   2> 786776 T2026 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-SyncSliceTest-1372297255130
[junit4:junit4]   2> 786778 T2026 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 786779 T2027 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 786879 T2026 oasc.ZkTestServer.run start zk server on port:53015
[junit4:junit4]   2> 786880 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 786893 T2033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fa99a71 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 786893 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 786893 T2026 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 786900 T2028 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f834a58e20000, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 786902 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 786905 T2035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f730d1a name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 786906 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 786906 T2026 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 786911 T2026 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 786916 T2026 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 786920 T2026 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 786925 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 786926 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 786935 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 786935 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 786941 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 786942 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 786949 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 786950 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 786954 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 786954 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 786959 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 786960 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 786965 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 786965 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 786970 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 786970 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 786975 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 786976 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 787382 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 787387 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53022
[junit4:junit4]   2> 787388 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 787388 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 787388 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334
[junit4:junit4]   2> 787389 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\solr.xml
[junit4:junit4]   2> 787389 T2026 oasc.CoreContainer.<init> New CoreContainer 757424083
[junit4:junit4]   2> 787389 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\'
[junit4:junit4]   2> 787391 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\'
[junit4:junit4]   2> 787500 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 787500 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 787500 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 787502 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 787503 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 787503 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 787511 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 787511 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
[junit4:junit4]   2> 787512 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 787514 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 787530 T2046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48373ee3 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 787532 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 787536 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 787537 T2028 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f834a58e20002, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 787547 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 787568 T2048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8ba95b name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 787568 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 787589 T2026 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 787603 T2026 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 787617 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 787623 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53022_kweo%2Fq
[junit4:junit4]   2> 787628 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53022_kweo%2Fq
[junit4:junit4]   2> 787642 T2026 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 787664 T2026 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 787675 T2026 oasc.Overseer.start Overseer (id=89934872912723971-127.0.0.1:53022_kweo%2Fq-n_0000000000) starting
[junit4:junit4]   2> 787691 T2026 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 787707 T2050 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 787710 T2026 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 787722 T2026 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 787729 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 787740 T2049 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 787751 T2051 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 787751 T2051 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 789246 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 789247 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53022_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53022/kweo/q"}
[junit4:junit4]   2> 789247 T2049 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 789247 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 789260 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 789758 T2051 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\collection1
[junit4:junit4]   2> 789758 T2051 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 789760 T2051 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 789761 T2051 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 789766 T2051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\collection1\'
[junit4:junit4]   2> 789770 T2051 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 789772 T2051 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334/collection1/lib/README' to classloader
[junit4:junit4]   2> 789826 T2051 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 789892 T2051 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 789895 T2051 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 789900 T2051 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 790577 T2051 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 790578 T2051 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 790578 T2051 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 790590 T2051 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 790594 T2051 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 790615 T2051 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 790620 T2051 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 790626 T2051 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 790627 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 790628 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 790628 T2051 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 790630 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 790630 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 790630 T2051 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 790630 T2051 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/control/data\
[junit4:junit4]   2> 790631 T2051 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
[junit4:junit4]   2> 790631 T2051 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 790632 T2051 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data
[junit4:junit4]   2> 790633 T2051 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/control/data\index/
[junit4:junit4]   2> 790634 T2051 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 790634 T2051 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index
[junit4:junit4]   2> 790643 T2051 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 790644 T2051 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 790646 T2051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 790646 T2051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 790647 T2051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 790647 T2051 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 790648 T2051 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 790648 T2051 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 790648 T2051 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 790649 T2051 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 790650 T2051 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 790657 T2051 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 790667 T2051 oass.SolrIndexSearcher.<init> Opening Searcher@5265e91e main
[junit4:junit4]   2> 790668 T2051 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 790669 T2051 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 790673 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5265e91e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 790674 T2051 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 790674 T2051 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53022/kweo/q collection:control_collection shard:shard1
[junit4:junit4]   2> 790676 T2051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 790691 T2051 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 790697 T2051 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 790697 T2051 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 790697 T2051 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53022/kweo/q/collection1/
[junit4:junit4]   2> 790698 T2051 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 790698 T2051 oasc.SyncStrategy.syncToMe http://127.0.0.1:53022/kweo/q/collection1/ has no replicas
[junit4:junit4]   2> 790698 T2051 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53022/kweo/q/collection1/
[junit4:junit4]   2> 790698 T2051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 790771 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 790786 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 790813 T2051 oasc.ZkController.register We are http://127.0.0.1:53022/kweo/q/collection1/ and leader is http://127.0.0.1:53022/kweo/q/collection1/
[junit4:junit4]   2> 790813 T2051 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53022/kweo/q
[junit4:junit4]   2> 790813 T2051 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 790813 T2051 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 790813 T2051 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 790818 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 790819 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 790819 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 790819 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 790828 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 790828 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 790833 T2055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59eb895f name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 790833 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 790835 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 790839 T2026 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 791290 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 791293 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53034
[junit4:junit4]   2> 791294 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 791294 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 791294 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191
[junit4:junit4]   2> 791296 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\solr.xml
[junit4:junit4]   2> 791296 T2026 oasc.CoreContainer.<init> New CoreContainer 534116845
[junit4:junit4]   2> 791296 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\'
[junit4:junit4]   2> 791296 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\'
[junit4:junit4]   2> 791395 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 791395 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 791395 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 791397 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 791397 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 791404 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 791405 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
[junit4:junit4]   2> 791405 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 791407 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 791423 T2066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@335e01c1 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 791423 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 791428 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 791435 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 791440 T2068 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c24b0a8 name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 791440 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 791451 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 792296 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 792297 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53022_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53022/kweo/q"}
[junit4:junit4]   2> 792310 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 792311 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 792312 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 792457 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53034_kweo%2Fq
[junit4:junit4]   2> 792460 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53034_kweo%2Fq
[junit4:junit4]   2> 792466 T2048 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 792466 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 792467 T2068 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 792467 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 792467 T2055 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 792467 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 792478 T2069 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 792478 T2069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 793819 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 793821 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53034_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53034/kweo/q"}
[junit4:junit4]   2> 793821 T2049 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 793821 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 793850 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 793851 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 793850 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 794482 T2069 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\collection1
[junit4:junit4]   2> 794482 T2069 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 794483 T2069 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 794483 T2069 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 794486 T2069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\collection1\'
[junit4:junit4]   2> 794488 T2069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 794488 T2069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191/collection1/lib/README' to classloader
[junit4:junit4]   2> 794548 T2069 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 794614 T2069 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 794617 T2069 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 794622 T2069 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 795330 T2069 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 795331 T2069 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 795332 T2069 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 795346 T2069 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 795350 T2069 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 795375 T2069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 795381 T2069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 795387 T2069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 795389 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 795389 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 795389 T2069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 795391 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 795392 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 795392 T2069 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 795392 T2069 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty1\
[junit4:junit4]   2> 795392 T2069 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
[junit4:junit4]   2> 795393 T2069 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 795394 T2069 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1
[junit4:junit4]   2> 795395 T2069 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty1\index/
[junit4:junit4]   2> 795396 T2069 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 795396 T2069 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index
[junit4:junit4]   2> 795407 T2069 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 795407 T2069 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 795410 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 795411 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 795411 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 795411 T2069 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 795412 T2069 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 795412 T2069 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 795412 T2069 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 795413 T2069 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 795413 T2069 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 795420 T2069 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 795431 T2069 oass.SolrIndexSearcher.<init> Opening Searcher@59663994 main
[junit4:junit4]   2> 795433 T2069 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 795433 T2069 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 795441 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59663994 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 795444 T2069 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 795445 T2069 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53034/kweo/q collection:collection1 shard:shard1
[junit4:junit4]   2> 795446 T2069 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 795475 T2069 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 795483 T2069 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 795483 T2069 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 795483 T2069 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 795483 T2069 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 795484 T2069 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/ has no replicas
[junit4:junit4]   2> 795484 T2069 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 795484 T2069 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 796864 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 796883 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 796883 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 796883 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 796924 T2069 oasc.ZkController.register We are http://127.0.0.1:53034/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 796924 T2069 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53034/kweo/q
[junit4:junit4]   2> 796924 T2069 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 796924 T2069 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 796925 T2069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 796928 T2069 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 796930 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 796930 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 796931 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 797348 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 797350 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53043
[junit4:junit4]   2> 797352 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 797352 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 797352 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290
[junit4:junit4]   2> 797353 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\solr.xml
[junit4:junit4]   2> 797353 T2026 oasc.CoreContainer.<init> New CoreContainer 1905806004
[junit4:junit4]   2> 797354 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\'
[junit4:junit4]   2> 797354 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\'
[junit4:junit4]   2> 797458 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 797459 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 797459 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 797459 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 797460 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 797460 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 797469 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 797469 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 797469 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 797470 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 797478 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 797478 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
[junit4:junit4]   2> 797479 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 797480 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 797496 T2082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32b443b6 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 797497 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 797500 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 797507 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 797511 T2084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e523969 name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 797511 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 797519 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 798395 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 798396 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53034_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53034/kweo/q"}
[junit4:junit4]   2> 798407 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 798407 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 798408 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 798407 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 798523 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53043_kweo%2Fq
[junit4:junit4]   2> 798526 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53043_kweo%2Fq
[junit4:junit4]   2> 798532 T2084 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 798532 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 798533 T2068 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 798533 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 798533 T2048 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 798533 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 798533 T2055 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 798535 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 798545 T2085 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 798545 T2085 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 799916 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 799917 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53043_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53043/kweo/q"}
[junit4:junit4]   2> 799917 T2049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 799918 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 799934 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 799934 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 799935 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 799934 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 800549 T2085 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\collection1
[junit4:junit4]   2> 800549 T2085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 800550 T2085 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 800551 T2085 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 800555 T2085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\collection1\'
[junit4:junit4]   2> 800557 T2085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 800559 T2085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290/collection1/lib/README' to classloader
[junit4:junit4]   2> 800611 T2085 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 800673 T2085 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 800675 T2085 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 800680 T2085 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 801470 T2085 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 801471 T2085 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 801472 T2085 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 801483 T2085 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 801488 T2085 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 801515 T2085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 801522 T2085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 801530 T2085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 801533 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 801533 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 801533 T2085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 801535 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 801536 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 801536 T2085 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 801536 T2085 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty2\
[junit4:junit4]   2> 801536 T2085 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
[junit4:junit4]   2> 801536 T2085 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 801538 T2085 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2
[junit4:junit4]   2> 801540 T2085 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty2\index/
[junit4:junit4]   2> 801542 T2085 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 801543 T2085 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index
[junit4:junit4]   2> 801555 T2085 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 801555 T2085 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 801558 T2085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 801558 T2085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 801560 T2085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 801560 T2085 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 801561 T2085 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 801561 T2085 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 801561 T2085 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 801562 T2085 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 801562 T2085 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 801570 T2085 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 801579 T2085 oass.SolrIndexSearcher.<init> Opening Searcher@4c2b72f5 main
[junit4:junit4]   2> 801581 T2085 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 801581 T2085 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 801589 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c2b72f5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 801592 T2085 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 801592 T2085 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53043/kweo/q collection:collection1 shard:shard1
[junit4:junit4]   2> 801599 T2085 oasc.ZkController.register We are http://127.0.0.1:53043/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 801600 T2085 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53043/kweo/q
[junit4:junit4]   2> 801600 T2085 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 801600 T2085 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C487 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C487_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
[junit4:junit4]   2> 801601 T2087 C487 P53043 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 801602 T2087 C487 P53043 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 801603 T2085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 801603 T2087 C487 P53043 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 801603 T2087 C487 P53043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 801605 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 801606 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 801606 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 801606 T2087 C487 P53043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 801617 T2062 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 802090 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 802094 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53053
[junit4:junit4]   2> 802094 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 802095 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 802096 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968
[junit4:junit4]   2> 802096 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\solr.xml
[junit4:junit4]   2> 802096 T2026 oasc.CoreContainer.<init> New CoreContainer 1283438405
[junit4:junit4]   2> 802097 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\'
[junit4:junit4]   2> 802097 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\'
[junit4:junit4]   2> 802211 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 802211 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 802213 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 802213 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 802213 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 802214 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 802214 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 802215 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 802215 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 802216 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 802224 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 802225 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
[junit4:junit4]   2> 802225 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 802227 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 802244 T2099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@438544d6 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 802244 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 802248 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 802255 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 802259 T2101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3248ded0 name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 802259 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 802270 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 802950 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 802951 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53043_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53043/kweo/q"}
[junit4:junit4]   2> 802958 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 802959 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 802959 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 802959 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 802960 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 803276 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53053_kweo%2Fq
[junit4:junit4]   2> 803279 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53053_kweo%2Fq
[junit4:junit4]   2> 803285 T2101 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 803286 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 803286 T2055 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 803286 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 803286 T2084 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 803286 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 803287 T2048 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 803288 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 803287 T2068 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 803289 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 803303 T2102 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 803303 T2102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 803617 T2062 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 803617 T2062 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=3&state=recovering&nodeName=127.0.0.1:53043_kweo%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2000 
[junit4:junit4]   2> 804471 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 804472 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53053_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53053/kweo/q"}
[junit4:junit4]   2> 804473 T2049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 804473 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 804489 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 804490 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 804490 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 804490 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 804490 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 805306 T2102 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\collection1
[junit4:junit4]   2> 805306 T2102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 805307 T2102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 805308 T2102 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 805311 T2102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\collection1\'
[junit4:junit4]   2> 805312 T2102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 805313 T2102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968/collection1/lib/README' to classloader
[junit4:junit4]   2> 805376 T2102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 805448 T2102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 805450 T2102 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 805455 T2102 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C488 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C488_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53034/kweo/q/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 805619 T2087 C488 P53043 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 805621 T2087 C488 P53043 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53034/kweo/q/collection1/. core=collection1
[junit4:junit4]   2> 805621 T2087 C488 P53043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C489 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C489_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
[junit4:junit4]   2> 805637 T2060 C489 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 805639 T2062 C489 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> ASYNC  NEW_CORE C490 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C490_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
[junit4:junit4]   2> 805646 T2060 C490 P53034 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 805657 T2060 C490 P53034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 805657 T2060 C490 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 805657 T2060 C490 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@76c3e82 realtime
[junit4:junit4]   2> 805657 T2060 C490 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 805658 T2060 C490 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4]   2> ASYNC  NEW_CORE C491 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C491_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
[junit4:junit4]   2> 805660 T2087 C491 P53043 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 805661 T2087 C491 P53043 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 805665 T2063 C490 P53034 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 805665 T2063 C490 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 805665 T2087 C491 P53043 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 805665 T2087 C491 P53043 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 805666 T2087 C491 P53043 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 805666 T2087 C491 P53043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 805673 T2087 C491 P53043 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 806040 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 806042 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53043_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53043/kweo/q"}
[junit4:junit4]   2> 806055 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 806056 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 806057 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 806056 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 806056 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 806269 T2102 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 806270 T2102 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 806270 T2102 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 806284 T2102 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 806289 T2102 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 806315 T2102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 806322 T2102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 806328 T2102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 806332 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 806332 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 806332 T2102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 806334 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 806334 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 806335 T2102 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 806335 T2102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty3\
[junit4:junit4]   2> 806335 T2102 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
[junit4:junit4]   2> 806337 T2102 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 806339 T2102 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3
[junit4:junit4]   2> 806340 T2102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty3\index/
[junit4:junit4]   2> 806344 T2102 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 806344 T2102 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index
[junit4:junit4]   2> 806356 T2102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 806356 T2102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 806362 T2102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 806363 T2102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 806363 T2102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 806364 T2102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 806366 T2102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 806366 T2102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 806371 T2102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 806373 T2102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 806373 T2102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 806381 T2102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 806393 T2102 oass.SolrIndexSearcher.<init> Opening Searcher@769295ba main
[junit4:junit4]   2> 806395 T2102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 806395 T2102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 806400 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@769295ba main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 806404 T2102 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 806405 T2102 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53053/kweo/q collection:collection1 shard:shard1
[junit4:junit4]   2> 806412 T2102 oasc.ZkController.register We are http://127.0.0.1:53053/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 806412 T2102 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53053/kweo/q
[junit4:junit4]   2> 806413 T2102 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 806413 T2102 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C492 name=collection1 org.apache.solr.core.SolrCore@6cc0fa26 url=http://127.0.0.1:53053/kweo/q/collection1 node=127.0.0.1:53053_kweo%2Fq C492_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53053_kweo%2Fq, base_url=http://127.0.0.1:53053/kweo/q}
[junit4:junit4]   2> 806414 T2105 C492 P53053 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 806415 T2105 C492 P53053 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 806415 T2102 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 806415 T2105 C492 P53053 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 806417 T2105 C492 P53053 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 806419 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 806420 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 806420 T2105 C492 P53053 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 806420 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 806432 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 806917 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 806922 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53066
[junit4:junit4]   2> 806924 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 806925 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 806925 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780
[junit4:junit4]   2> 806925 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\solr.xml
[junit4:junit4]   2> 806925 T2026 oasc.CoreContainer.<init> New CoreContainer 764575151
[junit4:junit4]   2> 806925 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\'
[junit4:junit4]   2> 806926 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\'
[junit4:junit4]   2> 807033 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 807033 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 807033 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 807034 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 807034 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 807035 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 807035 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 807036 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 807036 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 807036 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 807044 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 807045 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
[junit4:junit4]   2> 807045 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 807047 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 807065 T2117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1daa8d5b name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 807066 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 807073 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 807073 T2028 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f834a58e2000b, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 807079 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 807084 T2119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57eb830a name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 807084 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 807094 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 807722 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 807723 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53053_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53053/kweo/q"}
[junit4:junit4]   2> 807741 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 807742 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 807742 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 807742 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 807743 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 807742 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 808201 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53066_kweo%2Fq
[junit4:junit4]   2> 808207 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53066_kweo%2Fq
[junit4:junit4]   2> 808214 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 808218 T2055 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 808218 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 808219 T2101 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 808219 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 808220 T2048 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 808220 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 808222 T2068 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 808222 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 808223 T2084 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 808223 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 808228 T2119 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 808247 T2120 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 808247 T2120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 808632 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 808632 T2059 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:53053_kweo%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2200 
[junit4:junit4]   2> 809406 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 809407 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53066_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53066/kweo/q"}
[junit4:junit4]   2> 809408 T2049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 809408 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4]   2> 809422 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 809422 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 809423 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 809423 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 809423 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 809423 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 810451 T2120 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\collection1
[junit4:junit4]   2> 810451 T2120 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 810453 T2120 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 810453 T2120 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 810459 T2120 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\collection1\'
[junit4:junit4]   2> 810466 T2120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 810467 T2120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780/collection1/lib/README' to classloader
[junit4:junit4]   2> 810553 T2120 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4]   2> 810678 T2120 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 810681 T2120 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 810692 T2120 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C493 name=collection1 org.apache.solr.core.SolrCore@6cc0fa26 url=http://127.0.0.1:53053/kweo/q/collection1 node=127.0.0.1:53053_kweo%2Fq C493_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53053_kweo%2Fq, base_url=http://127.0.0.1:53053/kweo/q}
[junit4:junit4]   2> 810833 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53034/kweo/q/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 810834 T2105 C493 P53053 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 810834 T2105 C493 P53053 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 810835 T2105 C493 P53053 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53034/kweo/q/collection1/. core=collection1
[junit4:junit4]   2> 810836 T2105 C493 P53053 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C494 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C494_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
[junit4:junit4]   2> 810848 T2062 C494 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 810850 T2060 C494 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 810850 T2060 C494 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 810854 T2060 C494 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 810855 T2060 C494 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4]   2> 810856 T2105 C493 P53053 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 810856 T2105 C493 P53053 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 810862 T2061 C494 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 810863 T2105 C493 P53053 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 810863 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 810864 T2105 C493 P53053 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 810864 T2105 C493 P53053 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 810871 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 811096 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 811098 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53053_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53053/kweo/q"}
[junit4:junit4]   2> 811130 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 811130 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 811131 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 811141 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 811141 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 811142 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 811716 T2120 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 811717 T2120 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4]   2> 811718 T2120 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 811731 T2120 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 811737 T2120 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 811782 T2120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 811789 T2120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 811796 T2120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 811804 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 811804 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 811805 T2120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 811807 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 811807 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 811808 T2120 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 811808 T2120 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty4\
[junit4:junit4]   2> 811808 T2120 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
[junit4:junit4]   2> 811809 T2120 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 811812 T2120 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4
[junit4:junit4]   2> 811813 T2120 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty4\index/
[junit4:junit4]   2> 811815 T2120 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 811815 T2120 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index
[junit4:junit4]   2> 811836 T2120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 811836 T2120 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 811842 T2120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 811842 T2120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 811844 T2120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 811846 T2120 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 811847 T2120 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 811847 T2120 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 811854 T2120 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 811855 T2120 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 811856 T2120 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 811866 T2120 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 811880 T2120 oass.SolrIndexSearcher.<init> Opening Searcher@6a2123cf main
[junit4:junit4]   2> 811883 T2120 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 811883 T2120 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 811894 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a2123cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 811896 T2120 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 811896 T2120 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53066/kweo/q collection:collection1 shard:shard1
[junit4:junit4]   2> 811906 T2120 oasc.ZkController.register We are http://127.0.0.1:53066/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 811907 T2120 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53066/kweo/q
[junit4:junit4]   2> 811907 T2120 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 811907 T2120 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C495 name=collection1 org.apache.solr.core.SolrCore@77cbd382 url=http://127.0.0.1:53066/kweo/q/collection1 node=127.0.0.1:53066_kweo%2Fq C495_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53066_kweo%2Fq, base_url=http://127.0.0.1:53066/kweo/q}
[junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 811910 T2120 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 811912 T2123 C495 P53066 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 811915 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 811916 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 811918 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 811929 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 811930 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 811931 T2026 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 811933 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 811934 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 812802 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 812804 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53066_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53066/kweo/q"}
[junit4:junit4]   2> 812823 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 812824 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 812824 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 812825 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 812827 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 812827 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 813030 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 813030 T2059 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:53066_kweo%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1101 
[junit4:junit4]   2> 813036 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 814139 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C495_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53066_kweo%2Fq, base_url=http://127.0.0.1:53066/kweo/q}
[junit4:junit4]   2> 815231 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53034/kweo/q/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 815231 T2123 C495 P53066 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 815233 T2123 C495 P53066 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 815233 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 815234 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 815234 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 815234 T2123 C495 P53066 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 815234 T2123 C495 P53066 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53034/kweo/q/collection1/. core=collection1
[junit4:junit4]   2> 815235 T2123 C495 P53066 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C496 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C496_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
[junit4:junit4]   2> 815237 T2061 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 815241 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 815246 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 815246 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 815250 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 815250 T2063 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4]   2> 815253 T2123 C495 P53066 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 815253 T2123 C495 P53066 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 815258 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 815260 T2123 C495 P53066 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 815260 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 815260 T2123 C495 P53066 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 815262 T2123 C495 P53066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 815267 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 816142 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 816145 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "shard_state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard_range":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53066_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53066/kweo/q"}
[junit4:junit4]   2> 816172 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 816174 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 816174 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 816175 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 816175 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 816175 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 816345 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 816348 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C497 name=collection1 org.apache.solr.core.SolrCore@44c05a21 url=http://127.0.0.1:53022/kweo/q/collection1 node=127.0.0.1:53022_kweo%2Fq C497_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:53022_kweo%2Fq, base_url=http://127.0.0.1:53022/kweo/q, leader=true}
[junit4:junit4]   2> 816363 T2043 C497 P53022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 816375 T2043 C497 P53022 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 816377 T2043 C497 P53022 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 816377 T2043 C497 P53022 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 816378 T2043 C497 P53022 oass.SolrIndexSearcher.<init> Opening Searcher@1f609b02 main
[junit4:junit4]   2> 816379 T2043 C497 P53022 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 816380 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f609b02 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 816381 T2043 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4]   2> 816393 T2061 C496 P53034 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53034/kweo/q/collection1/, StdNode: http://127.0.0.1:53043/kweo/q/collection1/, StdNode: http://127.0.0.1:53053/kweo/q/collection1/, StdNode: http://127.0.0.1:53066/kweo/q/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 816400 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 816402 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 816406 T2063 C496 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@15726e09 main
[junit4:junit4]   2> 816406 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> ASYNC  NEW_CORE C498 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C498_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
[junit4:junit4]   2> 816413 T2076 C498 P53043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C495_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53066_kweo%2Fq, base_url=http://127.0.0.1:53066/kweo/q}
[junit4:junit4]   2> 816421 T2113 C495 P53066 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 816423 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15726e09 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 816423 T2063 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4]   2> 816426 T2113 C495 P53066 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 816429 T2076 C498 P53043 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 816430 T2113 C495 P53066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 816431 T2113 C495 P53066 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 816432 T2113 C495 P53066 oass.SolrIndexSearcher.<init> Opening Searcher@b682a4b main
[junit4:junit4]   2> 816432 T2113 C495 P53066 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 816433 T2076 C498 P53043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 816433 T2076 C498 P53043 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 816433 T2076 C498 P53043 oass.SolrIndexSearcher.<init> Opening Searcher@62d6eb4b main
[junit4:junit4]   2> 816435 T2076 C498 P53043 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 816436 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b682a4b main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 816437 T2113 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4]   2> ASYNC  NEW_CORE C499 name=collection1 org.apache.solr.core.SolrCore@6cc0fa26 url=http://127.0.0.1:53053/kweo/q/collection1 node=127.0.0.1:53053_kweo%2Fq C499_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53053_kweo%2Fq, base_url=http://127.0.0.1:53053/kweo/q}
[junit4:junit4]   2> 816438 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 816438 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62d6eb4b main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 816439 T2076 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4]   2> 816442 T2092 C499 P53053 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 816445 T2092 C499 P53053 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 816445 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 816446 T2092 C499 P53053 oass.SolrIndexSearcher.<init> Opening Searcher@9abff14 main
[junit4:junit4]   2> 816446 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 816446 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9abff14 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 816446 T2092 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4]   2> 816457 T2061 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 65
[junit4:junit4]   2> 816460 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 816466 T2064 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 816469 T2077 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 816472 T2093 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 816476 T2115 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 818479 T2042 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438957999831908352)} 0 4
[junit4:junit4]   2> 818498 T2076 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=FROMLEADER&_version_=-1438957999844491264&update.from=http://127.0.0.1:53034/kweo/q/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 3
[junit4:junit4]   2> 818506 T2096 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=FROMLEADER&_version_=-1438957999844491264&update.from=http://127.0.0.1:53034/kweo/q/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 8
[junit4:junit4]   2> 818511 T2112 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=FROMLEADER&_version_=-1438957999844491264&update.from=http://127.0.0.1:53034/kweo/q/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 10
[junit4:junit4]   2> 818513 T2063 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 26
[junit4:junit4]   2> 818514 T2075 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 32
[junit4:junit4]   2> 818521 T2043 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[0 (1438957999878045696)]} 0 3
[junit4:junit4]   2> 818538 T2092 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 3
[junit4:junit4]   2> 818538 T2077 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 3
[junit4:junit4]   2> 818538 T2113 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 6
[junit4:junit4]   2> 818540 T2061 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 15
[junit4:junit4]   2> 818545 T2044 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[1 (1438957999905308672)]} 0 1
[junit4:junit4]   2> 818560 T2115 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 2
[junit4:junit4]   2> 818561 T2093 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 1
[junit4:junit4]   2> 818562 T2078 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 0
[junit4:junit4]   2> 818563 T2064 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53043/kweo/q/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 8
[junit4:junit4]   2> 818565 T2079 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[1]} 0 14
[junit4:junit4]   2> 818572 T2039 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[2 (1438957999933620224)]} 0 1
[junit4:junit4]   2> 818577 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53043/kweo/q/collection1/]
[junit4:junit4]   2> 818577 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53043/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:true
[junit4:junit4]   2> 818578 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53053/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
[junit4:junit4]   2> 818578 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53066/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
[junit4:junit4]   2> 818583 T2114 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[2 (1438957999940960256)]} 0 0
[junit4:junit4]   2> 818586 T2095 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[2 (1438957999940960256)]} 0 3
[junit4:junit4]   2> 818588 T2062 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[2 (1438957999940960256)]} 0 12
[junit4:junit4]   2> 818594 T2040 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[3 (1438957999955640320)]} 0 2
[junit4:junit4]   2> 818602 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53043/kweo/q/collection1/]
[junit4:junit4]   2> 818603 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53043/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:true
[junit4:junit4]   2> 818603 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53053/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
[junit4:junit4]   2> 818604 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53066/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
[junit4:junit4]   2> 818611 T2097 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[3 (1438957999968223232)]} 0 1
[junit4:junit4]   2> 818611 T2110 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[3 (1438957999968223232)]} 0 1
[junit4:junit4]   2> 818613 T2060 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53053/kweo/q/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[3 (1438957999968223232)]} 0 11
[junit4:junit4]   2> 818614 T2094 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&test.distrib.skip.servers=http://127.0.0.1:53053/kweo/q/collection1/&wt=javabin&version=2} {add=[3]} 0 17
[junit4:junit4]   2> 818618 T2041 C497 P53022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 818715 T2041 C497 P53022 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 818716 T2041 C497 P53022 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 818732 T2041 C497 P53022 oass.SolrIndexSearcher.<init> Opening Searcher@2c66f922 main
[junit4:junit4]   2> 818734 T2041 C497 P53022 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 818736 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c66f922 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 818737 T2041 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 119
[junit4:junit4]   2> 818743 T2096 C499 P53053 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53034/kweo/q/collection1/, StdNode: http://127.0.0.1:53043/kweo/q/collection1/, StdNode: http://127.0.0.1:53053/kweo/q/collection1/, StdNode: http://127.0.0.1:53066/kweo/q/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 818748 T2059 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 818749 T2080 C498 P53043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 818752 T2111 C495 P53066 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 818748 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 818904 T2111 C495 P53066 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 818906 T2111 C495 P53066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 818907 T2059 C496 P53034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 818912 T2059 C496 P53034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 818917 T2092 C499 P53053 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 818918 T2092 C499 P53053 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 818923 T2111 C495 P53066 oass.SolrIndexSearcher.<init> Opening Searcher@6342d6b1 main
[junit4:junit4]   2> 818923 T2111 C495 P53066 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 818933 T2059 C496 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@5efd906e main
[junit4:junit4]   2> 818934 T2059 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 818934 T2092 C499 P53053 oass.SolrIndexSearcher.<init> Opening Searcher@2db61b13 main
[junit4:junit4]   2> 818935 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 818935 T2122 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:453)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1484)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:963)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:483)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 
[junit4:junit4]   2> 818936 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6342d6b1 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 818938 T2111 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 186
[junit4:junit4]   2> 818938 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5efd906e main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 818935 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2db61b13 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 818939 T2092 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 191
[junit4:junit4]   2> 818939 T2059 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 191
[junit4:junit4]   2> 818956 T2080 C498 P53043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 818957 T2080 C498 P53043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 818968 T2080 C498 P53043 oass.SolrIndexSearcher.<init> Opening Searcher@4d6df3bf main
[junit4:junit4]   2> 818970 T2080 C498 P53043 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 818971 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d6df3bf main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C2)}
[junit4:junit4]   2> 818972 T2080 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 223
[junit4:junit4]   2> 818972 T2096 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 230
[junit4:junit4]   2> 818974 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 818976 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 818978 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 818981 T2061 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 818986 T2075 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=2 
[junit4:junit4]   2> 818989 T2095 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 818995 T2113 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 818996 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 819012 T2097 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4]   2> 819013 T2097 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 819022 T2064 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4]   2> 819022 T2064 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 819023 T2064 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q START replicas=[http://127.0.0.1:53043/kweo/q/collection1/, http://127.0.0.1:53053/kweo/q/collection1/, http://127.0.0.1:53066/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 819027 T2077 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 819028 T2094 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 819029 T2115 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 819030 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Received 3 versions from 127.0.0.1:53043/kweo/q/collection1/
[junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999915794432
[junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Received 5 versions from 127.0.0.1:53053/kweo/q/collection1/
[junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
[junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Received 5 versions from 127.0.0.1:53066/kweo/q/collection1/
[junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
[junit4:junit4]   2> 819031 T2064 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q DONE. sync succeeded
[junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/: try and ask http://127.0.0.1:53043/kweo/q/collection1/ to sync
[junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/: try and ask http://127.0.0.1:53053/kweo/q/collection1/ to sync
[junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/: try and ask http://127.0.0.1:53066/kweo/q/collection1/ to sync
[junit4:junit4]   2> 819036 T2114 C495 P53066 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 819037 T2092 C499 P53053 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 819038 T2078 C498 P53043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
[junit4:junit4]   2> 819040 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 819042 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 819043 T2092 C499 P53053 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q  Received 5 versions from 127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 819043 T2092 C499 P53053 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
[junit4:junit4]   2> 819043 T2092 C499 P53053 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q DONE. sync succeeded
[junit4:junit4]   2> 819043 T2114 C495 P53066 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q  Received 5 versions from 127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 819044 T2114 C495 P53066 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
[junit4:junit4]   2> 819045 T2114 C495 P53066 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q DONE. sync succeeded
[junit4:junit4]   2> 819043 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 819045 T2114 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={sync=http://127.0.0.1:53034/kweo/q/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9 
[junit4:junit4]   2> 819044 T2092 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={sync=http://127.0.0.1:53034/kweo/q/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=8 
[junit4:junit4]   2> 819046 T2078 C498 P53043 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q  Received 5 versions from 127.0.0.1:53034/kweo/q/collection1/
[junit4:junit4]   2> 819047 T2078 C498 P53043 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q Requesting updates from 127.0.0.1:53034/kweo/q/collection1/n=2 versions=[1438957999968223232, 1438957999940960256]
[junit4:junit4]   2> 819047 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/:  sync completed with http://127.0.0.1:53053/kweo/q/collection1/
[junit4:junit4]   2> 819048 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/:  sync completed with http://127.0.0.1:53066/kweo/q/collection1/
[junit4:junit4]   2> 819052 T2063 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={distrib=false&getUpdates=1438957999968223232,1438957999940960256&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 819062 T2078 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438957999940960256), 3 (1438957999968223232)]} 0 8
[junit4:junit4]   2> 819062 T2078 C498 P53043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q DONE. sync succeeded
[junit4:junit4]   2> 819063 T2078 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={sync=http://127.0.0.1:53034/kweo/q/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=25 
[junit4:junit4]   2> 819064 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/:  sync completed with http://127.0.0.1:53043/kweo/q/collection1/
[junit4:junit4]   2> 819064 T2064 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=42 
[junit4:junit4]   2> 819065 T2097 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=54 
[junit4:junit4]   2> 819065 T2026 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 819065 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 819067 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 819068 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 819072 T2042 C497 P53022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 819072 T2042 C497 P53022 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 819076 T2042 C497 P53022 oass.SolrIndexSearcher.<init> Opening Searcher@4e3dfdb8 main
[junit4:junit4]   2> 819076 T2042 C497 P53022 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 819078 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e3dfdb8 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 819079 T2042 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 819082 T2093 C499 P53053 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53034/kweo/q/collection1/, StdNode: http://127.0.0.1:53043/kweo/q/collection1/, StdNode: http://127.0.0.1:53053/kweo/q/collection1/, StdNode: http://127.0.0.1:53066/kweo/q/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 819087 T2061 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 819087 T2061 C496 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 819087 T2110 C495 P53066 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 819089 T2110 C495 P53066 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 819087 T2096 C499 P53053 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 819088 T2079 C498 P53043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 819094 T2110 C495 P53066 oass.SolrIndexSearcher.<init> Opening Searcher@6745704e main
[junit4:junit4]   2> 819094 T2061 C496 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@369c7c33 main
[junit4:junit4]   2> 819095 T2061 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 819096 T2110 C495 P53066 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 819093 T2096 C499 P53053 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 819100 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@369c7c33 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 819101 T2061 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4]   2> 819102 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6745704e main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 819103 T2096 C499 P53053 oass.SolrIndexSearcher.<init> Opening Searcher@1e8cd23a main
[junit4:junit4]   2> 819104 T2096 C499 P53053 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 819103 T2110 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4]   2> 819107 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e8cd23a main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
[junit4:junit4]   2> 819108 T2096 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4]   2> 819150 T2079 C498 P53043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_3,generation=3}
[junit4:junit4]   2> 819151 T2079 C498 P53043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 819166 T2079 C498 P53043 oass.SolrIndexSearcher.<init> Opening Searcher@6039c183 main
[junit4:junit4]   2> 819167 T2079 C498 P53043 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 819168 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6039c183 main{StandardDirectoryReader(segments_3:5:nrt _0(4.4):C2 _1(4.4):C2)}
[junit4:junit4]   2> 819169 T2079 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 81
[junit4:junit4]   2> 819170 T2093 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 88
[junit4:junit4]   2> 819171 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 819176 T2060 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 819180 T2080 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 819184 T2095 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 819189 T2111 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 821171 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> check const of shard1
[junit4:junit4]   2> client0
[junit4:junit4]   2> PROPS:2:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53034_kweo%2Fq","base_url":"http://127.0.0.1:53034/kweo/q","leader":"true"}
[junit4:junit4]   2> 821177 T2064 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=2 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client1
[junit4:junit4]   2> PROPS:3:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53043_kweo%2Fq","base_url":"http://127.0.0.1:53043/kweo/q"}
[junit4:junit4]   2> 821181 T2078 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client2
[junit4:junit4]   2> PROPS:4:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53053_kweo%2Fq","base_url":"http://127.0.0.1:53053/kweo/q"}
[junit4:junit4]   2> 821185 T2096 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client3
[junit4:junit4]   2> PROPS:5:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53066_kweo%2Fq","base_url":"http://127.0.0.1:53066/kweo/q"}
[junit4:junit4]   2> 821189 T2114 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> 821193 T2061 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={q=*:*&wt=javabin&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 821206 T2041 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[4 (1438958002687180800)]} 0 8
[junit4:junit4]   2> 821213 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53066/kweo/q/collection1/]
[junit4:junit4]   2> 821215 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53043/kweo/q/collection1/ against:[http://127.0.0.1:53066/kweo/q/collection1/] result:false
[junit4:junit4]   2> 821215 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53053/kweo/q/collection1/ against:[http://127.0.0.1:53066/kweo/q/collection1/] result:false
[junit4:junit4]   2> 821215 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53066/kweo/q/collection1/ against:[http://127.0.0.1:53066/kweo/q/collection1/] result:true
[junit4:junit4]   2> 821232 T2079 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53066/kweo/q/collection1/&wt=javabin&version=2} {add=[4 (1438958002705006592)]} 0 6
[junit4:junit4]   2> 821244 T2093 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53066/kweo/q/collection1/&wt=javabin&version=2} {add=[4 (1438958002705006592)]} 0 9
[junit4:junit4]   2> 821245 T2060 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={test.distrib.skip.servers=http://127.0.0.1:53066/kweo/q/collection1/&wt=javabin&version=2} {add=[4 (1438958002705006592)]} 0 32
[junit4:junit4]   2> 821247 T2026 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 53034
[junit4:junit4]   2> 821261 T2026 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=534116845
[junit4:junit4]   2> 822185 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 822187 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53034_kweo%2Fq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53034/kweo/q"}
[junit4:junit4]   2> 822200 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 822201 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 822202 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 822203 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 822203 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 822203 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 823253 T2026 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 823253 T2026 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 823258 T2026 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7698b062
[junit4:junit4]   2> 823279 T2026 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 823279 T2026 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 823279 T2026 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 823280 T2026 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2>  C496_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
[junit4:junit4]   2> 823353 T2026 C496 P53034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_3,generation=3}
[junit4:junit4]   2> 823353 T2026 C496 P53034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 823359 T2026 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 823359 T2026 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 823360 T2026 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index;done=false>>]
[junit4:junit4]   2> 823361 T2026 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index
[junit4:junit4]   2> 823361 T2026 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1;done=false>>]
[junit4:junit4]   2> 823362 T2026 oasc.CachingDirectoryFactory.close Closing directory: 

[...truncated too long message...]

ction-queue-work (0)
[junit4:junit4]   1>   /solr/collections (2)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89934872912723982-2-n_0000000004 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89934872912723980-5-n_0000000003 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89934872912723978-4-n_0000000005 (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (1)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:53066_kweo%2Fq",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:53066/kweo/q"}
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89934872912723971-1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:53022_kweo%2Fq",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:53022/kweo/q"}
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (4)
[junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723978-127.0.0.1:53053_kweo%2Fq-n_0000000003 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723971-127.0.0.1:53022_kweo%2Fq-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723982-127.0.0.1:53034_kweo%2Fq-n_0000000005 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723980-127.0.0.1:53066_kweo%2Fq-n_0000000004 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89934872912723971-127.0.0.1:53022_kweo%2Fq-n_0000000000"}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=40763C2288D25CE0 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=US/Pacific -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  138s | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:53034/kweo/q/collection1lastClient and got 247 from http://127.0.0.1:53053/kweo/q/collection1
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([40763C2288D25CE0:C190B23AFF8D3CDC]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 924937 T2026 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=MockFixedIntBlock(blockSize=1448), text=Lucene41(blocksize=128), _version_=PostingsFormat(name=Memory doPackFST= false), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=MockFixedIntBlock(blockSize=1448), a_t=MockFixedIntBlock(blockSize=1448), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=MockFixedIntBlock(blockSize=1448), other_tl1=PostingsFormat(name=Memory doPackFST= false), multiDefault=MockFixedIntBlock(blockSize=1448), a_si=PostingsFormat(name=Memory doPackFST= false)}, docValues:{}, sim=DefaultSimilarity, locale=ca, timezone=US/Pacific
[junit4:junit4]   2> NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_45 (64-bit)/cpus=2,threads=1,free=109387464,total=326696960
[junit4:junit4]   2> NOTE: All tests run in this JVM: [IndexBasedSpellCheckerTest, DirectUpdateHandlerOptimizeTest, SuggesterTSTTest, SpellCheckCollatorTest, SuggesterWFSTTest, XsltUpdateRequestHandlerTest, TestComponentsName, BasicZkTest, WordBreakSolrSpellCheckerTest, TestRangeQuery, IndexSchemaRuntimeFieldTest, ZkCLITest, TestJmxMonitoredMap, TestSystemIdResolver, StandardRequestHandlerTest, RequestHandlersTest, BasicDistributedZk2Test, MinimalSchemaTest, AnalysisAfterCoreReloadTest, TestSearchPerf, TestSolrXmlPersistence, DisMaxRequestHandlerTest, TestWordDelimiterFilterFactory, TestCloudManagedSchema, TestPseudoReturnFields, TestSchemaNameResource, FileBasedSpellCheckerTest, TestPerFieldSimilarity, TestElisionMultitermQuery, TestSolrIndexConfig, TestSolrDeletionPolicy1, SortByFunctionTest, TestExtendedDismaxParser, TestPostingsSolrHighlighter, TestQuerySenderListener, SoftAutoCommitTest, SolrInfoMBeanTest, TestDocSet, CSVRequestHandlerTest, TestManagedSchemaFieldResource, TestLFUCache, TestStressVersions, TimeZoneUtilsTest, SimplePostToolTest, TestDocumentBuilder, ResourceLoaderTest, StatsComponentTest, TestCollationField, TestMergePolicyConfig, SpellingQueryConverterTest, DefaultValueUpdateProcessorTest, CurrencyFieldOpenExchangeTest, SolrTestCaseJ4Test, SchemaVersionSpecificBehaviorTest, SolrRequestParserTest, JSONWriterTest, OutputWriterTest, StatelessScriptUpdateProcessorFactoryTest, JsonLoaderTest, SignatureUpdateProcessorFactoryTest, DistributedQueryElevationComponentTest, BinaryUpdateRequestHandlerTest, TestFieldTypeResource, TestQuerySenderNoQuery, DirectUpdateHandlerTest, TestBM25SimilarityFactory, TestSerializedLuceneMatchVersion, UniqFieldsUpdateProcessorFactoryTest, TestFieldCollectionResource, TestIndexingPerformance, TestPartialUpdateDeduplication, CopyFieldTest, TestFuzzyAnalyzedSuggestions, TestCharFilters, IndexReaderFactoryTest, RegexBoostProcessorTest, TestLMDirichletSimilarityFactory, EchoParamsTest, TestSolrDeletionPolicy2, DocumentBuilderTest, TestLRUCache, TestManagedSchema, PreAnalyzedFieldTest, QueryResultKeyTest, LoggingHandlerTest, TestSchemaVersionResource, ShardRoutingTest, TestDefaultSimilarityFactory, TestJoin, TestMultiCoreConfBootstrap, SystemInfoHandlerTest, DirectSolrSpellCheckerTest, TestBadConfig, QueryElevationComponentTest, DistributedSpellCheckComponentTest, TestOmitPositions, TestStressLucene, TestSolrQueryParserResource, TestSort, TestQueryUtils, ZkNodePropsTest, UpdateRequestProcessorFactoryTest, BadCopyFieldTest, FastVectorHighlighterTest, TestSolr4Spatial, TestSolrJ, DocumentAnalysisRequestHandlerTest, NumericFieldsTest, TestSchemaResource, RequiredFieldsTest, TestFunctionQuery, DistributedTermsComponentTest, BadComponentTest, OpenExchangeRatesOrgProviderTest, DebugComponentTest, TestRandomDVFaceting, TestRemoteStreaming, FileUtilsTest, DirectSolrConnectionTest, TestFiltering, TestLazyCores, TestReload, TestSolrQueryParserDefaultOperatorResource, PingRequestHandlerTest, DOMUtilTest, TestLuceneMatchVersion, TestGroupingSearch, ScriptEngineTest, FieldMutatingUpdateProcessorTest, SolrIndexSplitterTest, TestDynamicFieldResource, TestConfig, TestAtomicUpdateErrorCases, TestFastWriter, SimpleFacetsTest, QueryEqualityTest, OverseerCollectionProcessorTest, SuggesterFSTTest, TermsComponentTest, BadIndexSchemaTest, SyncSliceTest]
[junit4:junit4] Completed in 138.20s, 1 test, 1 failure <<< FAILURES!

[...truncated 477 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1256 tests, 1 failure, 21 ignored (15 assumptions)

Total time: 66 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0_45 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.6.0_45) - Build # 2933 - Still Failing!

Posted by Mark Miller <ma...@gmail.com>.
I filed https://issues.apache.org/jira/browse/SOLR-4967 for this.

- Mark

On Jun 26, 2013, at 10:12 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2933/
> Java: 64bit/jdk1.6.0_45 -XX:-UseCompressedOops -XX:+UseParallelGC
> 
> 1 tests failed.
> FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch
> 
> Error Message:
> shard1 is not consistent.  Got 305 from http://127.0.0.1:53034/kweo/q/collection1lastClient and got 247 from http://127.0.0.1:53053/kweo/q/collection1
> 
> Stack Trace:
> java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:53034/kweo/q/collection1lastClient and got 247 from http://127.0.0.1:53053/kweo/q/collection1
> 	at __randomizedtesting.SeedInfo.seed([40763C2288D25CE0:C190B23AFF8D3CDC]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
> 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:662)
> 
> 
> 
> 
> Build Log:
> [...truncated 9115 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
> [junit4:junit4]   2> 786772 T2026 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /kweo/q
> [junit4:junit4]   2> 786776 T2026 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-SyncSliceTest-1372297255130
> [junit4:junit4]   2> 786778 T2026 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4]   2> 786779 T2027 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4:junit4]   2> 786879 T2026 oasc.ZkTestServer.run start zk server on port:53015
> [junit4:junit4]   2> 786880 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 786893 T2033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fa99a71 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 786893 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 786893 T2026 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4]   2> 786900 T2028 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f834a58e20000, likely client has closed socket
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 786902 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 786905 T2035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f730d1a name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 786906 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 786906 T2026 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4:junit4]   2> 786911 T2026 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4:junit4]   2> 786916 T2026 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4:junit4]   2> 786920 T2026 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4:junit4]   2> 786925 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 786926 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 786935 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
> [junit4:junit4]   2> 786935 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4:junit4]   2> 786941 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 786942 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 786949 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
> [junit4:junit4]   2> 786950 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4:junit4]   2> 786954 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
> [junit4:junit4]   2> 786954 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4:junit4]   2> 786959 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 786960 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 786965 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 786965 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 786970 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 786970 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 786975 T2026 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 786976 T2026 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 787382 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4]   2> 787387 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53022
> [junit4:junit4]   2> 787388 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 787388 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 787388 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334
> [junit4:junit4]   2> 787389 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\solr.xml
> [junit4:junit4]   2> 787389 T2026 oasc.CoreContainer.<init> New CoreContainer 757424083
> [junit4:junit4]   2> 787389 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\'
> [junit4:junit4]   2> 787391 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\'
> [junit4:junit4]   2> 787500 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4]   2> 787500 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 787500 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 787501 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 787502 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 787503 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 787503 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 787511 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4]   2> 787511 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
> [junit4:junit4]   2> 787512 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 787514 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 787530 T2046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48373ee3 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 787532 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 787536 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   2> 787537 T2028 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f834a58e20002, likely client has closed socket
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 787547 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 787568 T2048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8ba95b name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 787568 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 787589 T2026 oascc.SolrZkClient.makePath makePath: /overseer/queue
> [junit4:junit4]   2> 787603 T2026 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
> [junit4:junit4]   2> 787617 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4:junit4]   2> 787623 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53022_kweo%2Fq
> [junit4:junit4]   2> 787628 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53022_kweo%2Fq
> [junit4:junit4]   2> 787642 T2026 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4:junit4]   2> 787664 T2026 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4:junit4]   2> 787675 T2026 oasc.Overseer.start Overseer (id=89934872912723971-127.0.0.1:53022_kweo%2Fq-n_0000000000) starting
> [junit4:junit4]   2> 787691 T2026 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
> [junit4:junit4]   2> 787707 T2050 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
> [junit4:junit4]   2> 787710 T2026 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4:junit4]   2> 787722 T2026 oascc.SolrZkClient.makePath makePath: /aliases.json
> [junit4:junit4]   2> 787729 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 787740 T2049 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4:junit4]   2> 787751 T2051 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 787751 T2051 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 789246 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 789247 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"1",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"control_collection",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53022_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53022/kweo/q"}
> [junit4:junit4]   2> 789247 T2049 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
> [junit4:junit4]   2> 789247 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
> [junit4:junit4]   2> 789260 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 789758 T2051 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\collection1
> [junit4:junit4]   2> 789758 T2051 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4:junit4]   2> 789760 T2051 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 789761 T2051 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
> [junit4:junit4]   2> 789766 T2051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\collection1\'
> [junit4:junit4]   2> 789770 T2051 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 789772 T2051 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334/collection1/lib/README' to classloader
> [junit4:junit4]   2> 789826 T2051 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
> [junit4:junit4]   2> 789892 T2051 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 789895 T2051 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4]   2> 789900 T2051 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4]   2> 790577 T2051 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 790578 T2051 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 790578 T2051 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 790590 T2051 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 790594 T2051 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 790615 T2051 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 790620 T2051 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 790626 T2051 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 790627 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 790628 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 790628 T2051 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 790630 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 790630 T2051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 790630 T2051 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 790630 T2051 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1372297255334\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/control/data\
> [junit4:junit4]   2> 790631 T2051 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
> [junit4:junit4]   2> 790631 T2051 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 790632 T2051 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data
> [junit4:junit4]   2> 790633 T2051 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/control/data\index/
> [junit4:junit4]   2> 790634 T2051 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 790634 T2051 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index
> [junit4:junit4]   2> 790643 T2051 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 790644 T2051 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 790646 T2051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 790646 T2051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 790647 T2051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 790647 T2051 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 790648 T2051 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 790648 T2051 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 790648 T2051 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 790649 T2051 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 790650 T2051 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 790657 T2051 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 790667 T2051 oass.SolrIndexSearcher.<init> Opening Searcher@5265e91e main
> [junit4:junit4]   2> 790668 T2051 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 790669 T2051 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 790673 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5265e91e main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 790674 T2051 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 790674 T2051 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53022/kweo/q collection:control_collection shard:shard1
> [junit4:junit4]   2> 790676 T2051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4:junit4]   2> 790691 T2051 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 790697 T2051 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 790697 T2051 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 790697 T2051 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53022/kweo/q/collection1/
> [junit4:junit4]   2> 790698 T2051 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 790698 T2051 oasc.SyncStrategy.syncToMe http://127.0.0.1:53022/kweo/q/collection1/ has no replicas
> [junit4:junit4]   2> 790698 T2051 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53022/kweo/q/collection1/
> [junit4:junit4]   2> 790698 T2051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4:junit4]   2> 790771 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 790786 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 790813 T2051 oasc.ZkController.register We are http://127.0.0.1:53022/kweo/q/collection1/ and leader is http://127.0.0.1:53022/kweo/q/collection1/
> [junit4:junit4]   2> 790813 T2051 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53022/kweo/q
> [junit4:junit4]   2> 790813 T2051 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 790813 T2051 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 790813 T2051 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 790818 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 790819 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 790819 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 790819 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 790828 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:
> [junit4:junit4]   2> 790828 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 790833 T2055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59eb895f name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 790833 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 790835 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 790839 T2026 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
> [junit4:junit4]   2> 791290 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4]   2> 791293 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53034
> [junit4:junit4]   2> 791294 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 791294 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 791294 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191
> [junit4:junit4]   2> 791296 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\solr.xml
> [junit4:junit4]   2> 791296 T2026 oasc.CoreContainer.<init> New CoreContainer 534116845
> [junit4:junit4]   2> 791296 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\'
> [junit4:junit4]   2> 791296 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\'
> [junit4:junit4]   2> 791395 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4]   2> 791395 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 791395 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 791396 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 791397 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 791397 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 791404 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4]   2> 791405 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
> [junit4:junit4]   2> 791405 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 791407 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 791423 T2066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@335e01c1 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 791423 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 791428 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   2> 791435 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 791440 T2068 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c24b0a8 name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 791440 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 791451 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 792296 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 792297 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"1",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"control_collection",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53022_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53022/kweo/q"}
> [junit4:junit4]   2> 792310 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 792311 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 792312 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 792457 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53034_kweo%2Fq
> [junit4:junit4]   2> 792460 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53034_kweo%2Fq
> [junit4:junit4]   2> 792466 T2048 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4]   2> 792466 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 792467 T2068 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4]   2> 792467 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 792467 T2055 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4]   2> 792467 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 792478 T2069 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 792478 T2069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 793819 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 793821 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"2",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53034_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53034/kweo/q"}
> [junit4:junit4]   2> 793821 T2049 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
> [junit4:junit4]   2> 793821 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
> [junit4:junit4]   2> 793850 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 793851 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 793850 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 794482 T2069 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\collection1
> [junit4:junit4]   2> 794482 T2069 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 794483 T2069 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 794483 T2069 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 794486 T2069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\collection1\'
> [junit4:junit4]   2> 794488 T2069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 794488 T2069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191/collection1/lib/README' to classloader
> [junit4:junit4]   2> 794548 T2069 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
> [junit4:junit4]   2> 794614 T2069 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 794617 T2069 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4]   2> 794622 T2069 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4]   2> 795330 T2069 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 795331 T2069 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 795332 T2069 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 795346 T2069 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 795350 T2069 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 795375 T2069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 795381 T2069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 795387 T2069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 795389 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 795389 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 795389 T2069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 795391 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 795392 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 795392 T2069 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 795392 T2069 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1372297259191\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty1\
> [junit4:junit4]   2> 795392 T2069 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
> [junit4:junit4]   2> 795393 T2069 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 795394 T2069 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1
> [junit4:junit4]   2> 795395 T2069 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty1\index/
> [junit4:junit4]   2> 795396 T2069 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 795396 T2069 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index
> [junit4:junit4]   2> 795407 T2069 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 795407 T2069 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 795410 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 795411 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 795411 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 795411 T2069 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 795412 T2069 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 795412 T2069 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 795412 T2069 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 795413 T2069 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 795413 T2069 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 795420 T2069 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 795431 T2069 oass.SolrIndexSearcher.<init> Opening Searcher@59663994 main
> [junit4:junit4]   2> 795433 T2069 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 795433 T2069 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 795441 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59663994 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 795444 T2069 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 795445 T2069 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53034/kweo/q collection:collection1 shard:shard1
> [junit4:junit4]   2> 795446 T2069 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4:junit4]   2> 795475 T2069 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4]   2> 795483 T2069 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4]   2> 795483 T2069 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4]   2> 795483 T2069 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 795483 T2069 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 795484 T2069 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/ has no replicas
> [junit4:junit4]   2> 795484 T2069 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 795484 T2069 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 796864 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 796883 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 796883 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 796883 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 796924 T2069 oasc.ZkController.register We are http://127.0.0.1:53034/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 796924 T2069 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53034/kweo/q
> [junit4:junit4]   2> 796924 T2069 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4]   2> 796924 T2069 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 796925 T2069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 796928 T2069 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 796930 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 796930 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 796931 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 797348 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4]   2> 797350 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53043
> [junit4:junit4]   2> 797352 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 797352 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 797352 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290
> [junit4:junit4]   2> 797353 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\solr.xml
> [junit4:junit4]   2> 797353 T2026 oasc.CoreContainer.<init> New CoreContainer 1905806004
> [junit4:junit4]   2> 797354 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\'
> [junit4:junit4]   2> 797354 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\'
> [junit4:junit4]   2> 797458 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4]   2> 797459 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 797459 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 797459 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 797460 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 797460 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 797469 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 797469 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 797469 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 797470 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 797478 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4]   2> 797478 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
> [junit4:junit4]   2> 797479 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 797480 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 797496 T2082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32b443b6 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 797497 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 797500 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   2> 797507 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 797511 T2084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e523969 name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 797511 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 797519 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 798395 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 798396 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"2",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53034_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53034/kweo/q"}
> [junit4:junit4]   2> 798407 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 798407 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 798408 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 798407 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 798523 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53043_kweo%2Fq
> [junit4:junit4]   2> 798526 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53043_kweo%2Fq
> [junit4:junit4]   2> 798532 T2084 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 798532 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 798533 T2068 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 798533 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 798533 T2048 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 798533 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 798533 T2055 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4]   2> 798535 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 798545 T2085 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 798545 T2085 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 799916 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 799917 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"3",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53043_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53043/kweo/q"}
> [junit4:junit4]   2> 799917 T2049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
> [junit4:junit4]   2> 799918 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
> [junit4:junit4]   2> 799934 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 799934 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 799935 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 799934 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 800549 T2085 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\collection1
> [junit4:junit4]   2> 800549 T2085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 800550 T2085 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 800551 T2085 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 800555 T2085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\collection1\'
> [junit4:junit4]   2> 800557 T2085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 800559 T2085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290/collection1/lib/README' to classloader
> [junit4:junit4]   2> 800611 T2085 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
> [junit4:junit4]   2> 800673 T2085 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 800675 T2085 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4]   2> 800680 T2085 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4]   2> 801470 T2085 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 801471 T2085 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 801472 T2085 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 801483 T2085 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 801488 T2085 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 801515 T2085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 801522 T2085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 801530 T2085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 801533 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 801533 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 801533 T2085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 801535 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 801536 T2085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 801536 T2085 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 801536 T2085 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1372297265290\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty2\
> [junit4:junit4]   2> 801536 T2085 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
> [junit4:junit4]   2> 801536 T2085 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 801538 T2085 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2
> [junit4:junit4]   2> 801540 T2085 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty2\index/
> [junit4:junit4]   2> 801542 T2085 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 801543 T2085 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index
> [junit4:junit4]   2> 801555 T2085 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 801555 T2085 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 801558 T2085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 801558 T2085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 801560 T2085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 801560 T2085 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 801561 T2085 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 801561 T2085 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 801561 T2085 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 801562 T2085 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 801562 T2085 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 801570 T2085 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 801579 T2085 oass.SolrIndexSearcher.<init> Opening Searcher@4c2b72f5 main
> [junit4:junit4]   2> 801581 T2085 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 801581 T2085 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 801589 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c2b72f5 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 801592 T2085 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 801592 T2085 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53043/kweo/q collection:collection1 shard:shard1
> [junit4:junit4]   2> 801599 T2085 oasc.ZkController.register We are http://127.0.0.1:53043/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 801600 T2085 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53043/kweo/q
> [junit4:junit4]   2> 801600 T2085 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4]   2> 801600 T2085 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4]   2> ASYNC  NEW_CORE C487 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C487_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
> [junit4:junit4]   2> 801601 T2087 C487 P53043 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   2> 801602 T2087 C487 P53043 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4]   2> 801603 T2085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 801603 T2087 C487 P53043 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4]   2> 801603 T2087 C487 P53043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 801605 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 801606 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 801606 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 801606 T2087 C487 P53043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 801617 T2062 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
> [junit4:junit4]   2> 802090 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4]   2> 802094 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53053
> [junit4:junit4]   2> 802094 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 802095 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 802096 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968
> [junit4:junit4]   2> 802096 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\solr.xml
> [junit4:junit4]   2> 802096 T2026 oasc.CoreContainer.<init> New CoreContainer 1283438405
> [junit4:junit4]   2> 802097 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\'
> [junit4:junit4]   2> 802097 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\'
> [junit4:junit4]   2> 802211 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4]   2> 802211 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 802213 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 802213 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 802213 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 802214 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 802214 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 802215 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 802215 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 802216 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 802224 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4]   2> 802225 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
> [junit4:junit4]   2> 802225 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 802227 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 802244 T2099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@438544d6 name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 802244 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 802248 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   2> 802255 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 802259 T2101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3248ded0 name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 802259 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 802270 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 802950 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 802951 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"3",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"recovering",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53043_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53043/kweo/q"}
> [junit4:junit4]   2> 802958 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 802959 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 802959 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 802959 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 802960 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 803276 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53053_kweo%2Fq
> [junit4:junit4]   2> 803279 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53053_kweo%2Fq
> [junit4:junit4]   2> 803285 T2101 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 803286 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 803286 T2055 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 803286 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 803286 T2084 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 803286 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 803287 T2048 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 803288 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 803287 T2068 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4]   2> 803289 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 803303 T2102 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 803303 T2102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 803617 T2062 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
> [junit4:junit4]   2> 803617 T2062 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=3&state=recovering&nodeName=127.0.0.1:53043_kweo%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2000 
> [junit4:junit4]   2> 804471 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 804472 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"4",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53053_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53053/kweo/q"}
> [junit4:junit4]   2> 804473 T2049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
> [junit4:junit4]   2> 804473 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
> [junit4:junit4]   2> 804489 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 804490 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 804490 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 804490 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 804490 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 805306 T2102 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\collection1
> [junit4:junit4]   2> 805306 T2102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 805307 T2102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 805308 T2102 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 805311 T2102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\collection1\'
> [junit4:junit4]   2> 805312 T2102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 805313 T2102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968/collection1/lib/README' to classloader
> [junit4:junit4]   2> 805376 T2102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
> [junit4:junit4]   2> 805448 T2102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 805450 T2102 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4]   2> 805455 T2102 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4]   2> ASYNC  NEW_CORE C488 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C488_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53034/kweo/q/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4]   2> 805619 T2087 C488 P53043 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   2> 805621 T2087 C488 P53043 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53034/kweo/q/collection1/. core=collection1
> [junit4:junit4]   2> 805621 T2087 C488 P53043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> ASYNC  NEW_CORE C489 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C489_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
> [junit4:junit4]   2> 805637 T2060 C489 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 805639 T2062 C489 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
> [junit4:junit4]   2> ASYNC  NEW_CORE C490 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C490_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
> [junit4:junit4]   2> 805646 T2060 C490 P53034 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 805657 T2060 C490 P53034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 805657 T2060 C490 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 805657 T2060 C490 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@76c3e82 realtime
> [junit4:junit4]   2> 805657 T2060 C490 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 805658 T2060 C490 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
> [junit4:junit4]   2> ASYNC  NEW_CORE C491 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C491_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
> [junit4:junit4]   2> 805660 T2087 C491 P53043 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 805661 T2087 C491 P53043 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4]   2> 805665 T2063 C490 P53034 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 805665 T2063 C490 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
> [junit4:junit4]   2> 805665 T2087 C491 P53043 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4]   2> 805665 T2087 C491 P53043 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4]   2> 805666 T2087 C491 P53043 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 805666 T2087 C491 P53043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 805673 T2087 C491 P53043 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4]   2> 806040 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 806042 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"3",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53043_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53043/kweo/q"}
> [junit4:junit4]   2> 806055 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 806056 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 806057 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 806056 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 806056 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 806269 T2102 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 806270 T2102 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 806270 T2102 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 806284 T2102 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 806289 T2102 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 806315 T2102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 806322 T2102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 806328 T2102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 806332 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 806332 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 806332 T2102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 806334 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 806334 T2102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 806335 T2102 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 806335 T2102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1372297269968\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty3\
> [junit4:junit4]   2> 806335 T2102 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
> [junit4:junit4]   2> 806337 T2102 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 806339 T2102 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3
> [junit4:junit4]   2> 806340 T2102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty3\index/
> [junit4:junit4]   2> 806344 T2102 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 806344 T2102 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index
> [junit4:junit4]   2> 806356 T2102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 806356 T2102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 806362 T2102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 806363 T2102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 806363 T2102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 806364 T2102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 806366 T2102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 806366 T2102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 806371 T2102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 806373 T2102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 806373 T2102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 806381 T2102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 806393 T2102 oass.SolrIndexSearcher.<init> Opening Searcher@769295ba main
> [junit4:junit4]   2> 806395 T2102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 806395 T2102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 806400 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@769295ba main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 806404 T2102 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 806405 T2102 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53053/kweo/q collection:collection1 shard:shard1
> [junit4:junit4]   2> 806412 T2102 oasc.ZkController.register We are http://127.0.0.1:53053/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 806412 T2102 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53053/kweo/q
> [junit4:junit4]   2> 806413 T2102 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4]   2> 806413 T2102 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4]   2> ASYNC  NEW_CORE C492 name=collection1 org.apache.solr.core.SolrCore@6cc0fa26 url=http://127.0.0.1:53053/kweo/q/collection1 node=127.0.0.1:53053_kweo%2Fq C492_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53053_kweo%2Fq, base_url=http://127.0.0.1:53053/kweo/q}
> [junit4:junit4]   2> 806414 T2105 C492 P53053 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   2> 806415 T2105 C492 P53053 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4]   2> 806415 T2102 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 806415 T2105 C492 P53053 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4]   2> 806417 T2105 C492 P53053 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 806419 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 806420 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 806420 T2105 C492 P53053 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 806420 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 806432 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
> [junit4:junit4]   2> 806917 T2026 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4]   2> 806922 T2026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53066
> [junit4:junit4]   2> 806924 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 806925 T2026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 806925 T2026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780
> [junit4:junit4]   2> 806925 T2026 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\solr.xml
> [junit4:junit4]   2> 806925 T2026 oasc.CoreContainer.<init> New CoreContainer 764575151
> [junit4:junit4]   2> 806925 T2026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\'
> [junit4:junit4]   2> 806926 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\'
> [junit4:junit4]   2> 807033 T2026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4]   2> 807033 T2026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 807033 T2026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4]   2> 807034 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 807034 T2026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 807035 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 807035 T2026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 807036 T2026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 807036 T2026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 807036 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 807044 T2026 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4]   2> 807045 T2026 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53015/solr
> [junit4:junit4]   2> 807045 T2026 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4]   2> 807047 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 807065 T2117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1daa8d5b name:ZooKeeperConnection Watcher:127.0.0.1:53015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 807066 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 807073 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4]   2> 807073 T2028 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f834a58e2000b, likely client has closed socket
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
> [junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 807079 T2026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 807084 T2119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57eb830a name:ZooKeeperConnection Watcher:127.0.0.1:53015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4]   2> 807084 T2026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4]   2> 807094 T2026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4:junit4]   2> 807722 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 807723 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"4",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"recovering",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53053_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53053/kweo/q"}
> [junit4:junit4]   2> 807741 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 807742 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 807742 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 807742 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 807743 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 807742 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 808201 T2026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53066_kweo%2Fq
> [junit4:junit4]   2> 808207 T2026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53066_kweo%2Fq
> [junit4:junit4]   2> 808214 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4]   2> 808218 T2055 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 808218 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 808219 T2101 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 808219 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 808220 T2048 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 808220 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 808222 T2068 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 808222 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 808223 T2084 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 808223 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 808228 T2119 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4]   2> 808247 T2120 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 808247 T2120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 808632 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
> [junit4:junit4]   2> 808632 T2059 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:53053_kweo%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2200 
> [junit4:junit4]   2> 809406 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 809407 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"5",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53066_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53066/kweo/q"}
> [junit4:junit4]   2> 809408 T2049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
> [junit4:junit4]   2> 809408 T2049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
> [junit4:junit4]   2> 809422 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 809422 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 809423 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 809423 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 809423 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 809423 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 810451 T2120 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\collection1
> [junit4:junit4]   2> 810451 T2120 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4]   2> 810453 T2120 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4]   2> 810453 T2120 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4]   2> 810459 T2120 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\collection1\'
> [junit4:junit4]   2> 810466 T2120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780/collection1/lib/classes/' to classloader
> [junit4:junit4]   2> 810467 T2120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780/collection1/lib/README' to classloader
> [junit4:junit4]   2> 810553 T2120 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
> [junit4:junit4]   2> 810678 T2120 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 810681 T2120 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4]   2> 810692 T2120 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4]   2> ASYNC  NEW_CORE C493 name=collection1 org.apache.solr.core.SolrCore@6cc0fa26 url=http://127.0.0.1:53053/kweo/q/collection1 node=127.0.0.1:53053_kweo%2Fq C493_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53053_kweo%2Fq, base_url=http://127.0.0.1:53053/kweo/q}
> [junit4:junit4]   2> 810833 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53034/kweo/q/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4]   2> 810834 T2105 C493 P53053 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 810834 T2105 C493 P53053 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
> [junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4]   2> 810835 T2105 C493 P53053 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   2> 810835 T2105 C493 P53053 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53034/kweo/q/collection1/. core=collection1
> [junit4:junit4]   2> 810836 T2105 C493 P53053 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> ASYNC  NEW_CORE C494 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C494_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
> [junit4:junit4]   2> 810848 T2062 C494 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 810850 T2060 C494 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 810850 T2060 C494 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 810854 T2060 C494 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 810855 T2060 C494 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
> [junit4:junit4]   2> 810856 T2105 C493 P53053 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 810856 T2105 C493 P53053 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4]   2> 810862 T2061 C494 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 810863 T2105 C493 P53053 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4]   2> 810863 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4]   2> 810864 T2105 C493 P53053 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 810864 T2105 C493 P53053 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 810871 T2105 C493 P53053 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4]   2> 811096 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 811098 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"4",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53053_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53053/kweo/q"}
> [junit4:junit4]   2> 811130 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 811130 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 811131 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 811141 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 811141 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 811142 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 811716 T2120 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 811717 T2120 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4:junit4]   2> 811718 T2120 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 811731 T2120 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4]   2> 811737 T2120 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 811782 T2120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 811789 T2120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 811796 T2120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 811804 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 811804 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 811805 T2120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 811807 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4]   2> 811807 T2120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4]   2> 811808 T2120 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 811808 T2120 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1372297274780\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty4\
> [junit4:junit4]   2> 811808 T2120 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9c6a99d
> [junit4:junit4]   2> 811809 T2120 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
> [junit4:junit4]   2> 811812 T2120 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4
> [junit4:junit4]   2> 811813 T2120 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1372297255128/jetty4\index/
> [junit4:junit4]   2> 811815 T2120 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 811815 T2120 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index
> [junit4:junit4]   2> 811836 T2120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 811836 T2120 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 811842 T2120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 811842 T2120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 811844 T2120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 811846 T2120 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 811847 T2120 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 811847 T2120 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 811854 T2120 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 811855 T2120 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 811856 T2120 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 811866 T2120 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 811880 T2120 oass.SolrIndexSearcher.<init> Opening Searcher@6a2123cf main
> [junit4:junit4]   2> 811883 T2120 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 811883 T2120 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 811894 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a2123cf main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 811896 T2120 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 811896 T2120 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53066/kweo/q collection:collection1 shard:shard1
> [junit4:junit4]   2> 811906 T2120 oasc.ZkController.register We are http://127.0.0.1:53066/kweo/q/collection1/ and leader is http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 811907 T2120 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53066/kweo/q
> [junit4:junit4]   2> 811907 T2120 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4]   2> 811907 T2120 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4]   2> ASYNC  NEW_CORE C495 name=collection1 org.apache.solr.core.SolrCore@77cbd382 url=http://127.0.0.1:53066/kweo/q/collection1 node=127.0.0.1:53066_kweo%2Fq C495_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53066_kweo%2Fq, base_url=http://127.0.0.1:53066/kweo/q}
> [junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
> [junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4]   2> 811908 T2123 C495 P53066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 811910 T2120 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 811912 T2123 C495 P53066 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 811915 T2026 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 811916 T2026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 811918 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 811929 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 811930 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
> [junit4:junit4]   2> 811931 T2026 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
> [junit4:junit4]   2> 811933 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
> [junit4:junit4]   2> 811934 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 812802 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 812804 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"5",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"recovering",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53066_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53066/kweo/q"}
> [junit4:junit4]   2> 812823 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 812824 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 812824 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 812825 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 812827 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 812827 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 813030 T2059 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
> [junit4:junit4]   2> 813030 T2059 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:53066_kweo%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1101 
> [junit4:junit4]   2> 813036 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 814139 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2>  C495_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53066_kweo%2Fq, base_url=http://127.0.0.1:53066/kweo/q}
> [junit4:junit4]   2> 815231 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53034/kweo/q/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4]   2> 815231 T2123 C495 P53066 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 815233 T2123 C495 P53066 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
> [junit4:junit4]   2> 815233 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4]   2> 815234 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4]   2> 815234 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4]   2> 815234 T2123 C495 P53066 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4]   2> 815234 T2123 C495 P53066 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53034/kweo/q/collection1/. core=collection1
> [junit4:junit4]   2> 815235 T2123 C495 P53066 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> ASYNC  NEW_CORE C496 name=collection1 org.apache.solr.core.SolrCore@7698b062 url=http://127.0.0.1:53034/kweo/q/collection1 node=127.0.0.1:53034_kweo%2Fq C496_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
> [junit4:junit4]   2> 815237 T2061 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
> [junit4:junit4]   2> 815241 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 815246 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 815246 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 815250 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 815250 T2063 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
> [junit4:junit4]   2> 815253 T2123 C495 P53066 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 815253 T2123 C495 P53066 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4]   2> 815258 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 815260 T2123 C495 P53066 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4]   2> 815260 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4]   2> 815260 T2123 C495 P53066 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4]   2> 815262 T2123 C495 P53066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 815267 T2123 C495 P53066 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4]   2> 816142 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 816145 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"5",
> [junit4:junit4]   2> 	  "numShards":"1",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "shard_state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "shard_range":null,
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53066_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53066/kweo/q"}
> [junit4:junit4]   2> 816172 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 816174 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 816174 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 816175 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 816175 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 816175 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 816345 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 816348 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4]   2> ASYNC  NEW_CORE C497 name=collection1 org.apache.solr.core.SolrCore@44c05a21 url=http://127.0.0.1:53022/kweo/q/collection1 node=127.0.0.1:53022_kweo%2Fq C497_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:53022_kweo%2Fq, base_url=http://127.0.0.1:53022/kweo/q, leader=true}
> [junit4:junit4]   2> 816363 T2043 C497 P53022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 816375 T2043 C497 P53022 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 816377 T2043 C497 P53022 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 816377 T2043 C497 P53022 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 816378 T2043 C497 P53022 oass.SolrIndexSearcher.<init> Opening Searcher@1f609b02 main
> [junit4:junit4]   2> 816379 T2043 C497 P53022 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 816380 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f609b02 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4]   2> 816381 T2043 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 20
> [junit4:junit4]   2> 816393 T2061 C496 P53034 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53034/kweo/q/collection1/, StdNode: http://127.0.0.1:53043/kweo/q/collection1/, StdNode: http://127.0.0.1:53053/kweo/q/collection1/, StdNode: http://127.0.0.1:53066/kweo/q/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4]   2> 816400 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 816402 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 816406 T2063 C496 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@15726e09 main
> [junit4:junit4]   2> 816406 T2063 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> ASYNC  NEW_CORE C498 name=collection1 org.apache.solr.core.SolrCore@14c582bc url=http://127.0.0.1:53043/kweo/q/collection1 node=127.0.0.1:53043_kweo%2Fq C498_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53043_kweo%2Fq, base_url=http://127.0.0.1:53043/kweo/q}
> [junit4:junit4]   2> 816413 T2076 C498 P53043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2>  C495_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53066_kweo%2Fq, base_url=http://127.0.0.1:53066/kweo/q}
> [junit4:junit4]   2> 816421 T2113 C495 P53066 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 816423 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15726e09 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4]   2> 816423 T2063 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 23
> [junit4:junit4]   2> 816426 T2113 C495 P53066 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 816429 T2076 C498 P53043 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 816430 T2113 C495 P53066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 816431 T2113 C495 P53066 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 816432 T2113 C495 P53066 oass.SolrIndexSearcher.<init> Opening Searcher@b682a4b main
> [junit4:junit4]   2> 816432 T2113 C495 P53066 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 816433 T2076 C498 P53043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 816433 T2076 C498 P53043 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 816433 T2076 C498 P53043 oass.SolrIndexSearcher.<init> Opening Searcher@62d6eb4b main
> [junit4:junit4]   2> 816435 T2076 C498 P53043 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 816436 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b682a4b main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4]   2> 816437 T2113 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
> [junit4:junit4]   2> ASYNC  NEW_CORE C499 name=collection1 org.apache.solr.core.SolrCore@6cc0fa26 url=http://127.0.0.1:53053/kweo/q/collection1 node=127.0.0.1:53053_kweo%2Fq C499_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53053_kweo%2Fq, base_url=http://127.0.0.1:53053/kweo/q}
> [junit4:junit4]   2> 816438 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 816438 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62d6eb4b main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4]   2> 816439 T2076 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
> [junit4:junit4]   2> 816442 T2092 C499 P53053 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 816445 T2092 C499 P53053 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4]   2> 816445 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 816446 T2092 C499 P53053 oass.SolrIndexSearcher.<init> Opening Searcher@9abff14 main
> [junit4:junit4]   2> 816446 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 816446 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9abff14 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4]   2> 816446 T2092 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
> [junit4:junit4]   2> 816457 T2061 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 65
> [junit4:junit4]   2> 816460 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 816466 T2064 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1 
> [junit4:junit4]   2> 816469 T2077 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
> [junit4:junit4]   2> 816472 T2093 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
> [junit4:junit4]   2> 816476 T2115 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
> [junit4:junit4]   2> 818479 T2042 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438957999831908352)} 0 4
> [junit4:junit4]   2> 818498 T2076 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=FROMLEADER&_version_=-1438957999844491264&update.from=http://127.0.0.1:53034/kweo/q/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 3
> [junit4:junit4]   2> 818506 T2096 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=FROMLEADER&_version_=-1438957999844491264&update.from=http://127.0.0.1:53034/kweo/q/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 8
> [junit4:junit4]   2> 818511 T2112 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=FROMLEADER&_version_=-1438957999844491264&update.from=http://127.0.0.1:53034/kweo/q/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 10
> [junit4:junit4]   2> 818513 T2063 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438957999844491264)} 0 26
> [junit4:junit4]   2> 818514 T2075 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 32
> [junit4:junit4]   2> 818521 T2043 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[0 (1438957999878045696)]} 0 3
> [junit4:junit4]   2> 818538 T2092 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 3
> [junit4:junit4]   2> 818538 T2077 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 3
> [junit4:junit4]   2> 818538 T2113 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 6
> [junit4:junit4]   2> 818540 T2061 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[0 (1438957999884337152)]} 0 15
> [junit4:junit4]   2> 818545 T2044 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[1 (1438957999905308672)]} 0 1
> [junit4:junit4]   2> 818560 T2115 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 2
> [junit4:junit4]   2> 818561 T2093 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 1
> [junit4:junit4]   2> 818562 T2078 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 0
> [junit4:junit4]   2> 818563 T2064 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53043/kweo/q/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438957999915794432)]} 0 8
> [junit4:junit4]   2> 818565 T2079 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[1]} 0 14
> [junit4:junit4]   2> 818572 T2039 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[2 (1438957999933620224)]} 0 1
> [junit4:junit4]   2> 818577 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53043/kweo/q/collection1/]
> [junit4:junit4]   2> 818577 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53043/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:true
> [junit4:junit4]   2> 818578 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53053/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
> [junit4:junit4]   2> 818578 T2062 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53066/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
> [junit4:junit4]   2> 818583 T2114 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[2 (1438957999940960256)]} 0 0
> [junit4:junit4]   2> 818586 T2095 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[2 (1438957999940960256)]} 0 3
> [junit4:junit4]   2> 818588 T2062 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[2 (1438957999940960256)]} 0 12
> [junit4:junit4]   2> 818594 T2040 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[3 (1438957999955640320)]} 0 2
> [junit4:junit4]   2> 818602 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53043/kweo/q/collection1/]
> [junit4:junit4]   2> 818603 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53043/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:true
> [junit4:junit4]   2> 818603 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53053/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
> [junit4:junit4]   2> 818604 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53066/kweo/q/collection1/ against:[http://127.0.0.1:53043/kweo/q/collection1/] result:false
> [junit4:junit4]   2> 818611 T2097 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[3 (1438957999968223232)]} 0 1
> [junit4:junit4]   2> 818611 T2110 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[3 (1438957999968223232)]} 0 1
> [junit4:junit4]   2> 818613 T2060 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53053/kweo/q/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&wt=javabin&version=2} {add=[3 (1438957999968223232)]} 0 11
> [junit4:junit4]   2> 818614 T2094 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={test.distrib.skip.servers=http://127.0.0.1:53043/kweo/q/collection1/&test.distrib.skip.servers=http://127.0.0.1:53053/kweo/q/collection1/&wt=javabin&version=2} {add=[3]} 0 17
> [junit4:junit4]   2> 818618 T2041 C497 P53022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 818715 T2041 C497 P53022 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\control\data\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 818716 T2041 C497 P53022 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4]   2> 818732 T2041 C497 P53022 oass.SolrIndexSearcher.<init> Opening Searcher@2c66f922 main
> [junit4:junit4]   2> 818734 T2041 C497 P53022 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 818736 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c66f922 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 818737 T2041 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 119
> [junit4:junit4]   2> 818743 T2096 C499 P53053 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53034/kweo/q/collection1/, StdNode: http://127.0.0.1:53043/kweo/q/collection1/, StdNode: http://127.0.0.1:53053/kweo/q/collection1/, StdNode: http://127.0.0.1:53066/kweo/q/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4]   2> 818748 T2059 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 818749 T2080 C498 P53043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 818752 T2111 C495 P53066 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 818748 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 818904 T2111 C495 P53066 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty4\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 818906 T2111 C495 P53066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4]   2> 818907 T2059 C496 P53034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 818912 T2059 C496 P53034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4]   2> 818917 T2092 C499 P53053 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty3\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 818918 T2092 C499 P53053 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4]   2> 818923 T2111 C495 P53066 oass.SolrIndexSearcher.<init> Opening Searcher@6342d6b1 main
> [junit4:junit4]   2> 818923 T2111 C495 P53066 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 818933 T2059 C496 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@5efd906e main
> [junit4:junit4]   2> 818934 T2059 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 818934 T2092 C499 P53053 oass.SolrIndexSearcher.<init> Opening Searcher@2db61b13 main
> [junit4:junit4]   2> 818935 T2092 C499 P53053 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 818935 T2122 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
> [junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:453)
> [junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1484)
> [junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:963)
> [junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
> [junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
> [junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:483)
> [junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
> [junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
> [junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
> [junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
> [junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
> [junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
> [junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> [junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> [junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> [junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 818936 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6342d6b1 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 818938 T2111 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 186
> [junit4:junit4]   2> 818938 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5efd906e main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 818935 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2db61b13 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 818939 T2092 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 191
> [junit4:junit4]   2> 818939 T2059 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 191
> [junit4:junit4]   2> 818956 T2080 C498 P53043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 818957 T2080 C498 P53043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4]   2> 818968 T2080 C498 P53043 oass.SolrIndexSearcher.<init> Opening Searcher@4d6df3bf main
> [junit4:junit4]   2> 818970 T2080 C498 P53043 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 818971 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d6df3bf main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C2)}
> [junit4:junit4]   2> 818972 T2080 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 223
> [junit4:junit4]   2> 818972 T2096 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 230
> [junit4:junit4]   2> 818974 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
> [junit4:junit4]   2> 818976 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 818978 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4]   2> 818981 T2061 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
> [junit4:junit4]   2> 818986 T2075 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=2 
> [junit4:junit4]   2> 818989 T2095 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
> [junit4:junit4]   2> 818995 T2113 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
> [junit4:junit4]   2> 818996 T2026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 819012 T2097 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
> [junit4:junit4]   2> 819013 T2097 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> 819022 T2064 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
> [junit4:junit4]   2> 819022 T2064 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 819023 T2064 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q START replicas=[http://127.0.0.1:53043/kweo/q/collection1/, http://127.0.0.1:53053/kweo/q/collection1/, http://127.0.0.1:53066/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 819027 T2077 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 819028 T2094 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 819029 T2115 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
> [junit4:junit4]   2> 819030 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Received 3 versions from 127.0.0.1:53043/kweo/q/collection1/
> [junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999915794432
> [junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Received 5 versions from 127.0.0.1:53053/kweo/q/collection1/
> [junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
> [junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Received 5 versions from 127.0.0.1:53066/kweo/q/collection1/
> [junit4:junit4]   2> 819031 T2064 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
> [junit4:junit4]   2> 819031 T2064 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53034/kweo/q DONE. sync succeeded
> [junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/: try and ask http://127.0.0.1:53043/kweo/q/collection1/ to sync
> [junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/: try and ask http://127.0.0.1:53053/kweo/q/collection1/ to sync
> [junit4:junit4]   2> 819031 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/: try and ask http://127.0.0.1:53066/kweo/q/collection1/ to sync
> [junit4:junit4]   2> 819036 T2114 C495 P53066 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 819037 T2092 C499 P53053 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 819038 T2078 C498 P53043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q START replicas=[http://127.0.0.1:53034/kweo/q/collection1/] nUpdates=100
> [junit4:junit4]   2> 819040 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 819042 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 819043 T2092 C499 P53053 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q  Received 5 versions from 127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 819043 T2092 C499 P53053 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
> [junit4:junit4]   2> 819043 T2092 C499 P53053 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53053/kweo/q DONE. sync succeeded
> [junit4:junit4]   2> 819043 T2114 C495 P53066 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q  Received 5 versions from 127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 819044 T2114 C495 P53066 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q  Our versions are newer. ourLowThreshold=1438957999844491264 otherHigh=1438957999940960256
> [junit4:junit4]   2> 819045 T2114 C495 P53066 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53066/kweo/q DONE. sync succeeded
> [junit4:junit4]   2> 819043 T2062 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
> [junit4:junit4]   2> 819045 T2114 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={sync=http://127.0.0.1:53034/kweo/q/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9 
> [junit4:junit4]   2> 819044 T2092 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={sync=http://127.0.0.1:53034/kweo/q/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=8 
> [junit4:junit4]   2> 819046 T2078 C498 P53043 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q  Received 5 versions from 127.0.0.1:53034/kweo/q/collection1/
> [junit4:junit4]   2> 819047 T2078 C498 P53043 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q Requesting updates from 127.0.0.1:53034/kweo/q/collection1/n=2 versions=[1438957999968223232, 1438957999940960256]
> [junit4:junit4]   2> 819047 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/:  sync completed with http://127.0.0.1:53053/kweo/q/collection1/
> [junit4:junit4]   2> 819048 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/:  sync completed with http://127.0.0.1:53066/kweo/q/collection1/
> [junit4:junit4]   2> 819052 T2063 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={distrib=false&getUpdates=1438957999968223232,1438957999940960256&wt=javabin&qt=/get&version=2} status=0 QTime=1 
> [junit4:junit4]   2> 819062 T2078 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438957999940960256), 3 (1438957999968223232)]} 0 8
> [junit4:junit4]   2> 819062 T2078 C498 P53043 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53043/kweo/q DONE. sync succeeded
> [junit4:junit4]   2> 819063 T2078 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/get params={sync=http://127.0.0.1:53034/kweo/q/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=25 
> [junit4:junit4]   2> 819064 T2064 oasc.SyncStrategy.syncToMe http://127.0.0.1:53034/kweo/q/collection1/:  sync completed with http://127.0.0.1:53043/kweo/q/collection1/
> [junit4:junit4]   2> 819064 T2064 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=42 
> [junit4:junit4]   2> 819065 T2097 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=54 
> [junit4:junit4]   2> 819065 T2026 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
> [junit4:junit4]   2> 819065 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
> [junit4:junit4]   2> 819067 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 819068 T2026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4]   2> 819072 T2042 C497 P53022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 819072 T2042 C497 P53022 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 819076 T2042 C497 P53022 oass.SolrIndexSearcher.<init> Opening Searcher@4e3dfdb8 main
> [junit4:junit4]   2> 819076 T2042 C497 P53022 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 819078 T2052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e3dfdb8 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 819079 T2042 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
> [junit4:junit4]   2> 819082 T2093 C499 P53053 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53034/kweo/q/collection1/, StdNode: http://127.0.0.1:53043/kweo/q/collection1/, StdNode: http://127.0.0.1:53053/kweo/q/collection1/, StdNode: http://127.0.0.1:53066/kweo/q/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4]   2> 819087 T2061 C496 P53034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 819087 T2061 C496 P53034 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 819087 T2110 C495 P53066 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 819089 T2110 C495 P53066 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 819087 T2096 C499 P53053 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 819088 T2079 C498 P53043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4]   2> 819094 T2110 C495 P53066 oass.SolrIndexSearcher.<init> Opening Searcher@6745704e main
> [junit4:junit4]   2> 819094 T2061 C496 P53034 oass.SolrIndexSearcher.<init> Opening Searcher@369c7c33 main
> [junit4:junit4]   2> 819095 T2061 C496 P53034 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 819096 T2110 C495 P53066 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 819093 T2096 C499 P53053 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4]   2> 819100 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@369c7c33 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 819101 T2061 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 15
> [junit4:junit4]   2> 819102 T2122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6745704e main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 819103 T2096 C499 P53053 oass.SolrIndexSearcher.<init> Opening Searcher@1e8cd23a main
> [junit4:junit4]   2> 819104 T2096 C499 P53053 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 819103 T2110 C495 P53066 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
> [junit4:junit4]   2> 819107 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e8cd23a main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):C4)}
> [junit4:junit4]   2> 819108 T2096 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
> [junit4:junit4]   2> 819150 T2079 C498 P53043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty2\index,segFN=segments_3,generation=3}
> [junit4:junit4]   2> 819151 T2079 C498 P53043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
> [junit4:junit4]   2> 819166 T2079 C498 P53043 oass.SolrIndexSearcher.<init> Opening Searcher@6039c183 main
> [junit4:junit4]   2> 819167 T2079 C498 P53043 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 819168 T2086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6039c183 main{StandardDirectoryReader(segments_3:5:nrt _0(4.4):C2 _1(4.4):C2)}
> [junit4:junit4]   2> 819169 T2079 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 81
> [junit4:junit4]   2> 819170 T2093 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 88
> [junit4:junit4]   2> 819171 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 819176 T2060 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
> [junit4:junit4]   2> 819180 T2080 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
> [junit4:junit4]   2> 819184 T2095 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0 
> [junit4:junit4]   2> 819189 T2111 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
> [junit4:junit4]   2> 821171 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> check const of shard1
> [junit4:junit4]   2> client0
> [junit4:junit4]   2> PROPS:2:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53034_kweo%2Fq","base_url":"http://127.0.0.1:53034/kweo/q","leader":"true"}
> [junit4:junit4]   2> 821177 T2064 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=2 
> [junit4:junit4]   2>  live:true
> [junit4:junit4]   2>  num:4
> [junit4:junit4]   2> 
> [junit4:junit4]   2> client1
> [junit4:junit4]   2> PROPS:3:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53043_kweo%2Fq","base_url":"http://127.0.0.1:53043/kweo/q"}
> [junit4:junit4]   2> 821181 T2078 C498 P53043 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
> [junit4:junit4]   2>  live:true
> [junit4:junit4]   2>  num:4
> [junit4:junit4]   2> 
> [junit4:junit4]   2> client2
> [junit4:junit4]   2> PROPS:4:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53053_kweo%2Fq","base_url":"http://127.0.0.1:53053/kweo/q"}
> [junit4:junit4]   2> 821185 T2096 C499 P53053 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
> [junit4:junit4]   2>  live:true
> [junit4:junit4]   2>  num:4
> [junit4:junit4]   2> 
> [junit4:junit4]   2> client3
> [junit4:junit4]   2> PROPS:5:{"shard":"shard1","state":"active","core":"collection1","collection":"collection1","node_name":"127.0.0.1:53066_kweo%2Fq","base_url":"http://127.0.0.1:53066/kweo/q"}
> [junit4:junit4]   2> 821189 T2114 C495 P53066 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1 
> [junit4:junit4]   2>  live:true
> [junit4:junit4]   2>  num:4
> [junit4:junit4]   2> 
> [junit4:junit4]   2> 821193 T2061 C496 P53034 oasc.SolrCore.execute [collection1] webapp=/kweo/q path=/select params={q=*:*&wt=javabin&version=2} hits=4 status=0 QTime=1 
> [junit4:junit4]   2> 821206 T2041 C497 P53022 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={wt=javabin&version=2} {add=[4 (1438958002687180800)]} 0 8
> [junit4:junit4]   2> 821213 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53066/kweo/q/collection1/]
> [junit4:junit4]   2> 821215 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53043/kweo/q/collection1/ against:[http://127.0.0.1:53066/kweo/q/collection1/] result:false
> [junit4:junit4]   2> 821215 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53053/kweo/q/collection1/ against:[http://127.0.0.1:53066/kweo/q/collection1/] result:false
> [junit4:junit4]   2> 821215 T2060 C496 P53034 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53066/kweo/q/collection1/ against:[http://127.0.0.1:53066/kweo/q/collection1/] result:true
> [junit4:junit4]   2> 821232 T2079 C498 P53043 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53066/kweo/q/collection1/&wt=javabin&version=2} {add=[4 (1438958002705006592)]} 0 6
> [junit4:junit4]   2> 821244 T2093 C499 P53053 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={distrib.from=http://127.0.0.1:53034/kweo/q/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53066/kweo/q/collection1/&wt=javabin&version=2} {add=[4 (1438958002705006592)]} 0 9
> [junit4:junit4]   2> 821245 T2060 C496 P53034 oasup.LogUpdateProcessor.finish [collection1] webapp=/kweo/q path=/update params={test.distrib.skip.servers=http://127.0.0.1:53066/kweo/q/collection1/&wt=javabin&version=2} {add=[4 (1438958002705006592)]} 0 32
> [junit4:junit4]   2> 821247 T2026 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 53034
> [junit4:junit4]   2> 821261 T2026 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=534116845
> [junit4:junit4]   2> 822185 T2049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4:junit4]   2> 822187 T2049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "core_node_name":"2",
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:53034_kweo%2Fq",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53034/kweo/q"}
> [junit4:junit4]   2> 822200 T2119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 822201 T2101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 822202 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 822203 T2084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 822203 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 822203 T2048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4]   2> 823253 T2026 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4]   2> 823253 T2026 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4]   2> 823258 T2026 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7698b062
> [junit4:junit4]   2> 823279 T2026 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
> [junit4:junit4]   2> 823279 T2026 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
> [junit4:junit4]   2> 823279 T2026 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 823280 T2026 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2>  C496_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53034_kweo%2Fq, base_url=http://127.0.0.1:53034/kweo/q, leader=true}
> [junit4:junit4]   2> 823353 T2026 C496 P53034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_1,generation=1}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_2,generation=2}
> [junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index,segFN=segments_3,generation=3}
> [junit4:junit4]   2> 823353 T2026 C496 P53034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
> [junit4:junit4]   2> 823359 T2026 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 823359 T2026 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
> [junit4:junit4]   2> 823360 T2026 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index;done=false>>]
> [junit4:junit4]   2> 823361 T2026 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1\index
> [junit4:junit4]   2> 823361 T2026 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1372297255128\jetty1;done=false>>]
> [junit4:junit4]   2> 823362 T2026 oasc.CachingDirectoryFactory.close Closing directory: 
> 
> [...truncated too long message...]
> 
> ction-queue-work (0)
> [junit4:junit4]   1>   /solr/collections (2)
> [junit4:junit4]   1>    /solr/collections/collection1 (3)
> [junit4:junit4]   1>    DATA:
> [junit4:junit4]   1>        {"configName":"conf1"}
> [junit4:junit4]   1>     /solr/collections/collection1/shards (0)
> [junit4:junit4]   1>     /solr/collections/collection1/leader_elect (1)
> [junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
> [junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (3)
> [junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89934872912723982-2-n_0000000004 (0)
> [junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89934872912723980-5-n_0000000003 (0)
> [junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89934872912723978-4-n_0000000005 (0)
> [junit4:junit4]   1>     /solr/collections/collection1/leaders (1)
> [junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:53066_kweo%2Fq",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:53066/kweo/q"}
> [junit4:junit4]   1>    /solr/collections/control_collection (3)
> [junit4:junit4]   1>    DATA:
> [junit4:junit4]   1>        {"configName":"conf1"}
> [junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
> [junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
> [junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
> [junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89934872912723971-1-n_0000000000 (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
> [junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:53022_kweo%2Fq",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:53022/kweo/q"}
> [junit4:junit4]   1>   /solr/overseer_elect (2)
> [junit4:junit4]   1>    /solr/overseer_elect/election (4)
> [junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723978-127.0.0.1:53053_kweo%2Fq-n_0000000003 (0)
> [junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723971-127.0.0.1:53022_kweo%2Fq-n_0000000000 (0)
> [junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723982-127.0.0.1:53034_kweo%2Fq-n_0000000005 (0)
> [junit4:junit4]   1>     /solr/overseer_elect/election/89934872912723980-127.0.0.1:53066_kweo%2Fq-n_0000000004 (0)
> [junit4:junit4]   1>    /solr/overseer_elect/leader (0)
> [junit4:junit4]   1>    DATA:
> [junit4:junit4]   1>        {"id":"89934872912723971-127.0.0.1:53022_kweo%2Fq-n_0000000000"}
> [junit4:junit4]   1>  /zookeeper (1)
> [junit4:junit4]   1>  DATA:
> [junit4:junit4]   1>      
> [junit4:junit4]   1> 
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=40763C2288D25CE0 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=US/Pacific -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE  138s | SyncSliceTest.testDistribSearch <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:53034/kweo/q/collection1lastClient and got 247 from http://127.0.0.1:53053/kweo/q/collection1
> [junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([40763C2288D25CE0:C190B23AFF8D3CDC]:0)
> [junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
> [junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
> [junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
> [junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> 924937 T2026 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=MockFixedIntBlock(blockSize=1448), text=Lucene41(blocksize=128), _version_=PostingsFormat(name=Memory doPackFST= false), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=MockFixedIntBlock(blockSize=1448), a_t=MockFixedIntBlock(blockSize=1448), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=MockFixedIntBlock(blockSize=1448), other_tl1=PostingsFormat(name=Memory doPackFST= false), multiDefault=MockFixedIntBlock(blockSize=1448), a_si=PostingsFormat(name=Memory doPackFST= false)}, docValues:{}, sim=DefaultSimilarity, locale=ca, timezone=US/Pacific
> [junit4:junit4]   2> NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_45 (64-bit)/cpus=2,threads=1,free=109387464,total=326696960
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [IndexBasedSpellCheckerTest, DirectUpdateHandlerOptimizeTest, SuggesterTSTTest, SpellCheckCollatorTest, SuggesterWFSTTest, XsltUpdateRequestHandlerTest, TestComponentsName, BasicZkTest, WordBreakSolrSpellCheckerTest, TestRangeQuery, IndexSchemaRuntimeFieldTest, ZkCLITest, TestJmxMonitoredMap, TestSystemIdResolver, StandardRequestHandlerTest, RequestHandlersTest, BasicDistributedZk2Test, MinimalSchemaTest, AnalysisAfterCoreReloadTest, TestSearchPerf, TestSolrXmlPersistence, DisMaxRequestHandlerTest, TestWordDelimiterFilterFactory, TestCloudManagedSchema, TestPseudoReturnFields, TestSchemaNameResource, FileBasedSpellCheckerTest, TestPerFieldSimilarity, TestElisionMultitermQuery, TestSolrIndexConfig, TestSolrDeletionPolicy1, SortByFunctionTest, TestExtendedDismaxParser, TestPostingsSolrHighlighter, TestQuerySenderListener, SoftAutoCommitTest, SolrInfoMBeanTest, TestDocSet, CSVRequestHandlerTest, TestManagedSchemaFieldResource, TestLFUCache, TestStressVersions, TimeZoneUtilsTest, SimplePostToolTest, TestDocumentBuilder, ResourceLoaderTest, StatsComponentTest, TestCollationField, TestMergePolicyConfig, SpellingQueryConverterTest, DefaultValueUpdateProcessorTest, CurrencyFieldOpenExchangeTest, SolrTestCaseJ4Test, SchemaVersionSpecificBehaviorTest, SolrRequestParserTest, JSONWriterTest, OutputWriterTest, StatelessScriptUpdateProcessorFactoryTest, JsonLoaderTest, SignatureUpdateProcessorFactoryTest, DistributedQueryElevationComponentTest, BinaryUpdateRequestHandlerTest, TestFieldTypeResource, TestQuerySenderNoQuery, DirectUpdateHandlerTest, TestBM25SimilarityFactory, TestSerializedLuceneMatchVersion, UniqFieldsUpdateProcessorFactoryTest, TestFieldCollectionResource, TestIndexingPerformance, TestPartialUpdateDeduplication, CopyFieldTest, TestFuzzyAnalyzedSuggestions, TestCharFilters, IndexReaderFactoryTest, RegexBoostProcessorTest, TestLMDirichletSimilarityFactory, EchoParamsTest, TestSolrDeletionPolicy2, DocumentBuilderTest, TestLRUCache, TestManagedSchema, PreAnalyzedFieldTest, QueryResultKeyTest, LoggingHandlerTest, TestSchemaVersionResource, ShardRoutingTest, TestDefaultSimilarityFactory, TestJoin, TestMultiCoreConfBootstrap, SystemInfoHandlerTest, DirectSolrSpellCheckerTest, TestBadConfig, QueryElevationComponentTest, DistributedSpellCheckComponentTest, TestOmitPositions, TestStressLucene, TestSolrQueryParserResource, TestSort, TestQueryUtils, ZkNodePropsTest, UpdateRequestProcessorFactoryTest, BadCopyFieldTest, FastVectorHighlighterTest, TestSolr4Spatial, TestSolrJ, DocumentAnalysisRequestHandlerTest, NumericFieldsTest, TestSchemaResource, RequiredFieldsTest, TestFunctionQuery, DistributedTermsComponentTest, BadComponentTest, OpenExchangeRatesOrgProviderTest, DebugComponentTest, TestRandomDVFaceting, TestRemoteStreaming, FileUtilsTest, DirectSolrConnectionTest, TestFiltering, TestLazyCores, TestReload, TestSolrQueryParserDefaultOperatorResource, PingRequestHandlerTest, DOMUtilTest, TestLuceneMatchVersion, TestGroupingSearch, ScriptEngineTest, FieldMutatingUpdateProcessorTest, SolrIndexSplitterTest, TestDynamicFieldResource, TestConfig, TestAtomicUpdateErrorCases, TestFastWriter, SimpleFacetsTest, QueryEqualityTest, OverseerCollectionProcessorTest, SuggesterFSTTest, TermsComponentTest, BadIndexSchemaTest, SyncSliceTest]
> [junit4:junit4] Completed in 138.20s, 1 test, 1 failure <<< FAILURES!
> 
> [...truncated 477 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1256 tests, 1 failure, 21 ignored (15 assumptions)
> 
> Total time: 66 minutes 57 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.6.0_45 -XX:-UseCompressedOops -XX:+UseParallelGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org