You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/16 10:06:42 UTC
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_21) - Build #
2896 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2896/
Java: 32bit/jdk1.7.0_21 -server -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard2 is not consistent. Got 132 from http://127.0.0.1:65468/y_ip/pk/collection1lastClient and got 117 from http://127.0.0.1:65496/y_ip/pk/collection1
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 132 from http://127.0.0.1:65468/y_ip/pk/collection1lastClient and got 117 from http://127.0.0.1:65496/y_ip/pk/collection1
at __randomizedtesting.SeedInfo.seed([C0F2EFD4734535B9:411461CC041A5585]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9558 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 756622 T2315 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /y_ip/pk
[junit4:junit4] 2> 756627 T2315 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1371368150928
[junit4:junit4] 2> 756630 T2315 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 756631 T2316 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 756726 T2315 oasc.ZkTestServer.run start zk server on port:65440
[junit4:junit4] 2> 756729 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 756738 T2322 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6954a name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 756738 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 756738 T2315 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 756746 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a0000, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 756748 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 756752 T2324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b623b1 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 756752 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 756752 T2315 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 756758 T2315 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 756763 T2315 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 756768 T2315 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 756773 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 756774 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 756784 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 756785 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 756792 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 756793 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 756799 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 756799 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 756805 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 756806 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 756812 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 756812 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 756818 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 756819 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 756826 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 756827 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 756834 T2315 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 756835 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 756845 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a0001, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 757328 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 757341 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65447
[junit4:junit4] 2> 757342 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 757343 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 757343 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143
[junit4:junit4] 2> 757344 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143\solr.xml
[junit4:junit4] 2> 757345 T2315 oasc.CoreContainer.<init> New CoreContainer 24498396
[junit4:junit4] 2> 757345 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143\'
[junit4:junit4] 2> 757345 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143\'
[junit4:junit4] 2> 757501 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 757502 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 757503 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 757503 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 757504 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 757504 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 757505 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 757505 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 757506 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 757506 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 757522 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 757523 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 757523 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 757526 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 757539 T2335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c233f6 name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 757540 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 757544 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 757544 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a0002, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 757552 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 757556 T2337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25349e name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 757557 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 757560 T2315 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 757570 T2315 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 757576 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 757581 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65447_y_ip%2Fpk
[junit4:junit4] 2> 757584 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65447_y_ip%2Fpk
[junit4:junit4] 2> 757589 T2315 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 757602 T2315 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 757607 T2315 oasc.Overseer.start Overseer (id=89873983139872771-127.0.0.1:65447_y_ip%2Fpk-n_0000000000) starting
[junit4:junit4] 2> 757616 T2315 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 757626 T2339 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 757628 T2315 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 757635 T2315 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 757640 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 757646 T2338 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 757651 T2340 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 757652 T2340 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 759095 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 759096 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65447_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65447/y_ip/pk"}
[junit4:junit4] 2> 759096 T2338 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 759096 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 759109 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 759575 T2340 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143\collection1
[junit4:junit4] 2> 759575 T2340 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 759576 T2340 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 759577 T2340 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 759581 T2340 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143\collection1\'
[junit4:junit4] 2> 759583 T2340 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 759584 T2340 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143/collection1/lib/README' to classloader
[junit4:junit4] 2> 759657 T2340 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 759714 T2340 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 759717 T2340 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 759721 T2340 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 760418 T2340 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 760429 T2340 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 760434 T2340 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 760462 T2340 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 760469 T2340 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 760477 T2340 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 760482 T2340 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 760482 T2340 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 760482 T2340 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 760484 T2340 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 760484 T2340 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 760485 T2340 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 760525 T2340 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371368151143\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/control/data\
[junit4:junit4] 2> 760525 T2340 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 760526 T2340 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 760527 T2340 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\control\data
[junit4:junit4] 2> 760527 T2340 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/control/data\index/
[junit4:junit4] 2> 760528 T2340 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 760529 T2340 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\control\data\index
[junit4:junit4] 2> 760551 T2340 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 760551 T2340 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 760555 T2340 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 760555 T2340 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 760557 T2340 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 760558 T2340 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 760559 T2340 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 760559 T2340 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 760559 T2340 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 760560 T2340 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 760560 T2340 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 760573 T2340 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 760588 T2340 oass.SolrIndexSearcher.<init> Opening Searcher@1195ebd main
[junit4:junit4] 2> 760590 T2340 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 760590 T2340 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 760597 T2340 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 760598 T2340 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65447/y_ip/pk collection:control_collection shard:shard1
[junit4:junit4] 2> 760600 T2341 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1195ebd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 760600 T2340 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 760616 T2340 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 760621 T2340 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 760622 T2340 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 760622 T2340 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65447/y_ip/pk/collection1/
[junit4:junit4] 2> 760622 T2340 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 760622 T2340 oasc.SyncStrategy.syncToMe http://127.0.0.1:65447/y_ip/pk/collection1/ has no replicas
[junit4:junit4] 2> 760622 T2340 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65447/y_ip/pk/collection1/
[junit4:junit4] 2> 760623 T2340 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 762002 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 762028 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 762065 T2340 oasc.ZkController.register We are http://127.0.0.1:65447/y_ip/pk/collection1/ and leader is http://127.0.0.1:65447/y_ip/pk/collection1/
[junit4:junit4] 2> 762065 T2340 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65447/y_ip/pk
[junit4:junit4] 2> 762065 T2340 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 762066 T2340 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 762066 T2340 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 762070 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 762073 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 762073 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 762074 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 762088 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 762091 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 762095 T2344 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aac441 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 762096 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 762100 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 762105 T2315 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 762566 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 762571 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65459
[junit4:junit4] 2> 762572 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 762573 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 762573 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405
[junit4:junit4] 2> 762573 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405\solr.xml
[junit4:junit4] 2> 762573 T2315 oasc.CoreContainer.<init> New CoreContainer 32559996
[junit4:junit4] 2> 762573 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405\'
[junit4:junit4] 2> 762573 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405\'
[junit4:junit4] 2> 762711 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 762711 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 762712 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 762712 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 762712 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 762712 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 762712 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 762713 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 762713 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 762714 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 762723 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 762724 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 762725 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 762726 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 762742 T2355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@290f55 name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 762743 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 762749 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 762756 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 762763 T2357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1442ef9 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 762763 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 762774 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 763482 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 763483 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65447_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65447_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65447/y_ip/pk"}
[junit4:junit4] 2> 763495 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 763496 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 763497 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 763740 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65459_y_ip%2Fpk
[junit4:junit4] 2> 763743 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65459_y_ip%2Fpk
[junit4:junit4] 2> 763748 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 763749 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 763750 T2337 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 763750 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 763754 T2357 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 763755 T2344 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 763767 T2358 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 763767 T2358 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 764866 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 764868 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65459_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65459/y_ip/pk"}
[junit4:junit4] 2> 764868 T2338 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 764868 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 764883 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 764883 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 764883 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 765537 T2358 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405\collection1
[junit4:junit4] 2> 765537 T2358 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 765538 T2358 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 765538 T2358 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 765540 T2358 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405\collection1\'
[junit4:junit4] 2> 765542 T2358 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 765543 T2358 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405/collection1/lib/README' to classloader
[junit4:junit4] 2> 765591 T2358 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 765646 T2358 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 765647 T2358 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 765653 T2358 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 766214 T2358 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 766223 T2358 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 766227 T2358 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 766248 T2358 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 766253 T2358 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 766258 T2358 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 766260 T2358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 766260 T2358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 766260 T2358 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 766262 T2358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 766262 T2358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 766262 T2358 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 766263 T2358 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371368156405\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty1\
[junit4:junit4] 2> 766263 T2358 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 766263 T2358 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 766265 T2358 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1
[junit4:junit4] 2> 766265 T2358 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty1\index/
[junit4:junit4] 2> 766266 T2358 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 766266 T2358 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1\index
[junit4:junit4] 2> 766276 T2358 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 766276 T2358 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 766279 T2358 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 766280 T2358 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 766280 T2358 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 766281 T2358 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 766282 T2358 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 766282 T2358 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 766282 T2358 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 766282 T2358 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 766282 T2358 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 766294 T2358 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 766303 T2358 oass.SolrIndexSearcher.<init> Opening Searcher@2bf58f main
[junit4:junit4] 2> 766306 T2358 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 766306 T2358 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 766311 T2359 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bf58f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 766313 T2358 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 766314 T2358 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65459/y_ip/pk collection:collection1 shard:shard1
[junit4:junit4] 2> 766314 T2358 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 766329 T2358 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 766335 T2358 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 766335 T2358 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 766336 T2358 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65459/y_ip/pk/collection1/
[junit4:junit4] 2> 766336 T2358 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 766336 T2358 oasc.SyncStrategy.syncToMe http://127.0.0.1:65459/y_ip/pk/collection1/ has no replicas
[junit4:junit4] 2> 766336 T2358 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65459/y_ip/pk/collection1/
[junit4:junit4] 2> 766336 T2358 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 767487 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 767505 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 767505 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 767505 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 767536 T2358 oasc.ZkController.register We are http://127.0.0.1:65459/y_ip/pk/collection1/ and leader is http://127.0.0.1:65459/y_ip/pk/collection1/
[junit4:junit4] 2> 767536 T2358 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65459/y_ip/pk
[junit4:junit4] 2> 767536 T2358 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 767536 T2358 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 767537 T2358 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 767542 T2358 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 767544 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 767545 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 767545 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 767906 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 767910 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65468
[junit4:junit4] 2> 767911 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 767911 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 767912 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853
[junit4:junit4] 2> 767912 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853\solr.xml
[junit4:junit4] 2> 767912 T2315 oasc.CoreContainer.<init> New CoreContainer 23871463
[junit4:junit4] 2> 767913 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853\'
[junit4:junit4] 2> 767913 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853\'
[junit4:junit4] 2> 768011 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 768012 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 768012 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 768013 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 768013 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 768013 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 768014 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 768015 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 768015 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 768016 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 768022 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 768022 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 768022 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 768024 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 768039 T2371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f2b0ff name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 768040 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 768044 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 768051 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 768055 T2373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59274c name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 768055 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 768063 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 768827 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 768828 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65459_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65459_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65459/y_ip/pk"}
[junit4:junit4] 2> 768837 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 768838 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 768838 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 768839 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 768933 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65468_y_ip%2Fpk
[junit4:junit4] 2> 768935 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65468_y_ip%2Fpk
[junit4:junit4] 2> 768939 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 768939 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 768941 T2337 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 768941 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 768942 T2373 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 768942 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 768945 T2357 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 768946 T2344 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 768955 T2374 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 768955 T2374 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 770144 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 770145 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65468_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65468/y_ip/pk"}
[junit4:junit4] 2> 770145 T2338 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 770145 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 770155 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770156 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770156 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770157 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770687 T2374 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853\collection1
[junit4:junit4] 2> 770688 T2374 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 770689 T2374 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 770689 T2374 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 770691 T2374 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853\collection1\'
[junit4:junit4] 2> 770695 T2374 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 770695 T2374 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853/collection1/lib/README' to classloader
[junit4:junit4] 2> 770749 T2374 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 770810 T2374 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 770813 T2374 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 770816 T2374 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 771417 T2374 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 771425 T2374 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 771428 T2374 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 771449 T2374 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 771455 T2374 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 771460 T2374 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 771461 T2374 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 771462 T2374 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 771462 T2374 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 771464 T2374 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 771464 T2374 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 771464 T2374 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 771464 T2374 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371368161853\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty2\
[junit4:junit4] 2> 771465 T2374 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 771465 T2374 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 771466 T2374 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2
[junit4:junit4] 2> 771466 T2374 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty2\index/
[junit4:junit4] 2> 771469 T2374 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 771469 T2374 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2\index
[junit4:junit4] 2> 771479 T2374 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 771480 T2374 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 771482 T2374 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 771482 T2374 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 771483 T2374 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 771484 T2374 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 771484 T2374 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 771484 T2374 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 771485 T2374 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 771485 T2374 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 771486 T2374 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 771498 T2374 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 771509 T2374 oass.SolrIndexSearcher.<init> Opening Searcher@19dbb1a main
[junit4:junit4] 2> 771511 T2374 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 771512 T2374 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 771516 T2375 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19dbb1a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 771519 T2374 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 771519 T2374 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65468/y_ip/pk collection:collection1 shard:shard2
[junit4:junit4] 2> 771520 T2374 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 771532 T2374 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 771536 T2374 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 771537 T2374 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 771537 T2374 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65468/y_ip/pk/collection1/
[junit4:junit4] 2> 771537 T2374 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 771538 T2374 oasc.SyncStrategy.syncToMe http://127.0.0.1:65468/y_ip/pk/collection1/ has no replicas
[junit4:junit4] 2> 771538 T2374 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65468/y_ip/pk/collection1/
[junit4:junit4] 2> 771538 T2374 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 772761 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 772779 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772780 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772780 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772780 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772830 T2374 oasc.ZkController.register We are http://127.0.0.1:65468/y_ip/pk/collection1/ and leader is http://127.0.0.1:65468/y_ip/pk/collection1/
[junit4:junit4] 2> 772830 T2374 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65468/y_ip/pk
[junit4:junit4] 2> 772830 T2374 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 772830 T2374 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 772831 T2374 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 772834 T2374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 772836 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 772836 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 772837 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 773282 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 773287 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65477
[junit4:junit4] 2> 773288 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 773289 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 773289 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143
[junit4:junit4] 2> 773289 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143\solr.xml
[junit4:junit4] 2> 773290 T2315 oasc.CoreContainer.<init> New CoreContainer 21757832
[junit4:junit4] 2> 773290 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143\'
[junit4:junit4] 2> 773291 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143\'
[junit4:junit4] 2> 773395 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 773395 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 773395 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 773396 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 773396 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 773397 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 773397 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 773398 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 773398 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 773399 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 773405 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 773406 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 773406 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 773408 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 773424 T2387 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@88d45a name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 773425 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 773429 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 773429 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a0009, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 773435 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 773440 T2389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15b123f name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 773440 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 773448 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 774222 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 774223 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65468_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65468_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65468/y_ip/pk"}
[junit4:junit4] 2> 774237 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774238 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774238 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774239 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774238 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774404 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65477_y_ip%2Fpk
[junit4:junit4] 2> 774406 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65477_y_ip%2Fpk
[junit4:junit4] 2> 774410 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774411 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 774413 T2337 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 774413 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 774414 T2373 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 774414 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 774414 T2389 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 774414 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 774416 T2344 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 774417 T2357 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 774427 T2390 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 774427 T2390 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 775677 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 775678 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65477_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65477/y_ip/pk"}
[junit4:junit4] 2> 775678 T2338 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 775678 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 775690 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775691 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775691 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775692 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775692 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 776332 T2390 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143\collection1
[junit4:junit4] 2> 776332 T2390 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 776332 T2390 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 776333 T2390 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 776336 T2390 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143\collection1\'
[junit4:junit4] 2> 776337 T2390 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 776338 T2390 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143/collection1/lib/README' to classloader
[junit4:junit4] 2> 776390 T2390 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 776450 T2390 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 776453 T2390 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 776458 T2390 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 777068 T2390 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 777077 T2390 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 777081 T2390 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 777104 T2390 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 777110 T2390 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 777115 T2390 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 777117 T2390 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 777117 T2390 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 777117 T2390 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 777119 T2390 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 777119 T2390 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 777120 T2390 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 777120 T2390 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371368167143\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty3\
[junit4:junit4] 2> 777120 T2390 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 777121 T2390 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 777122 T2390 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty3
[junit4:junit4] 2> 777123 T2390 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty3\index/
[junit4:junit4] 2> 777125 T2390 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 777125 T2390 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty3\index
[junit4:junit4] 2> 777136 T2390 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 777136 T2390 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 777140 T2390 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 777140 T2390 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 777140 T2390 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 777141 T2390 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 777141 T2390 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 777141 T2390 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 777142 T2390 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 777142 T2390 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 777143 T2390 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 777153 T2390 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 777165 T2390 oass.SolrIndexSearcher.<init> Opening Searcher@1164195 main
[junit4:junit4] 2> 777166 T2390 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 777166 T2390 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 777172 T2391 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1164195 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 777174 T2390 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 777174 T2390 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65477/y_ip/pk collection:collection1 shard:shard3
[junit4:junit4] 2> 777175 T2390 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 777188 T2390 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 777193 T2390 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 777193 T2390 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 777193 T2390 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65477/y_ip/pk/collection1/
[junit4:junit4] 2> 777194 T2390 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 777194 T2390 oasc.SyncStrategy.syncToMe http://127.0.0.1:65477/y_ip/pk/collection1/ has no replicas
[junit4:junit4] 2> 777194 T2390 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65477/y_ip/pk/collection1/
[junit4:junit4] 2> 777194 T2390 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 778557 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 778582 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 778582 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 778582 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 778582 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 778582 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 778610 T2390 oasc.ZkController.register We are http://127.0.0.1:65477/y_ip/pk/collection1/ and leader is http://127.0.0.1:65477/y_ip/pk/collection1/
[junit4:junit4] 2> 778610 T2390 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65477/y_ip/pk
[junit4:junit4] 2> 778610 T2390 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 778611 T2390 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 778611 T2390 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 778617 T2390 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 778625 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 778625 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 778626 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 779039 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 779043 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65486
[junit4:junit4] 2> 779045 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 779045 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 779046 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941
[junit4:junit4] 2> 779046 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941\solr.xml
[junit4:junit4] 2> 779046 T2315 oasc.CoreContainer.<init> New CoreContainer 11392691
[junit4:junit4] 2> 779047 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941\'
[junit4:junit4] 2> 779047 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941\'
[junit4:junit4] 2> 779152 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 779152 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 779153 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 779153 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 779153 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 779153 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 779154 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 779154 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 779154 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 779155 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 779163 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 779163 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 779163 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 779166 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 779181 T2403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@99cce0 name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 779182 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 779185 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 779186 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a000b, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 779195 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 779199 T2405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19cc015 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 779199 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 779210 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 780023 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 780024 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65477_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65477_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65477/y_ip/pk"}
[junit4:junit4] 2> 780040 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780040 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780041 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780042 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780043 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780044 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780166 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65486_y_ip%2Fpk
[junit4:junit4] 2> 780169 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65486_y_ip%2Fpk
[junit4:junit4] 2> 780173 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780173 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780173 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 780175 T2389 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 780175 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780176 T2373 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 780176 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780177 T2337 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 780177 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780181 T2344 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 780181 T2405 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 780182 T2357 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 780191 T2406 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 780191 T2406 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 781480 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 781481 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65486_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65486/y_ip/pk"}
[junit4:junit4] 2> 781482 T2338 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 781482 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 781496 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 781497 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 781498 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 781498 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 781499 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 781499 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 782096 T2406 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941\collection1
[junit4:junit4] 2> 782096 T2406 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 782097 T2406 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 782098 T2406 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 782100 T2406 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941\collection1\'
[junit4:junit4] 2> 782102 T2406 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 782102 T2406 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941/collection1/lib/README' to classloader
[junit4:junit4] 2> 782156 T2406 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 782219 T2406 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 782222 T2406 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 782229 T2406 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 782936 T2406 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 782947 T2406 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 782950 T2406 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 782973 T2406 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 782978 T2406 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 782984 T2406 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 782985 T2406 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 782986 T2406 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 782986 T2406 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 782988 T2406 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 782988 T2406 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 782988 T2406 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 782988 T2406 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371368172941\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty4\
[junit4:junit4] 2> 782989 T2406 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 782989 T2406 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 782990 T2406 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4
[junit4:junit4] 2> 782991 T2406 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty4\index/
[junit4:junit4] 2> 782993 T2406 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 782993 T2406 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index
[junit4:junit4] 2> 783005 T2406 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 783006 T2406 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 783009 T2406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 783009 T2406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 783010 T2406 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 783012 T2406 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 783012 T2406 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 783012 T2406 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 783013 T2406 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 783013 T2406 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 783014 T2406 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 783024 T2406 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 783036 T2406 oass.SolrIndexSearcher.<init> Opening Searcher@1ac9f39 main
[junit4:junit4] 2> 783038 T2406 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 783038 T2406 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 783043 T2407 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ac9f39 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 783046 T2406 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 783046 T2406 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65486/y_ip/pk collection:collection1 shard:shard1
[junit4:junit4] 2> 783052 T2406 oasc.ZkController.register We are http://127.0.0.1:65486/y_ip/pk/collection1/ and leader is http://127.0.0.1:65459/y_ip/pk/collection1/
[junit4:junit4] 2> 783053 T2406 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65486/y_ip/pk
[junit4:junit4] 2> 783053 T2406 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 783053 T2406 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C374 name=collection1 org.apache.solr.core.SolrCore@80ae3e url=http://127.0.0.1:65486/y_ip/pk/collection1 node=127.0.0.1:65486_y_ip%2Fpk C374_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65486_y_ip%2Fpk, base_url=http://127.0.0.1:65486/y_ip/pk}
[junit4:junit4] 2> 783054 T2408 C374 P65486 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 783055 T2408 C374 P65486 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 783055 T2408 C374 P65486 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 783055 T2408 C374 P65486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 783056 T2406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 783057 T2408 C374 P65486 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 783060 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 783060 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 783061 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 783070 T2352 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:65486_y_ip%2Fpk_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 783538 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 783544 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65496
[junit4:junit4] 2> 783545 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 783545 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 783545 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366
[junit4:junit4] 2> 783546 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366\solr.xml
[junit4:junit4] 2> 783546 T2315 oasc.CoreContainer.<init> New CoreContainer 25740704
[junit4:junit4] 2> 783547 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366\'
[junit4:junit4] 2> 783548 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366\'
[junit4:junit4] 2> 783684 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 783684 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 783684 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 783685 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 783685 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 783685 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 783686 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 783686 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 783687 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 783687 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 783695 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 783696 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 783696 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 783698 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 783715 T2420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15e4e29 name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 783719 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 783731 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 783731 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a000d, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 783738 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 783743 T2422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b531a0 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 783744 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 783754 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 784573 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 784575 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65486_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65486_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65486/y_ip/pk"}
[junit4:junit4] 2> 784590 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784591 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784591 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784591 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784593 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784593 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784594 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784806 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65496_y_ip%2Fpk
[junit4:junit4] 2> 784810 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65496_y_ip%2Fpk
[junit4:junit4] 2> 784815 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784816 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784816 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784817 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 784820 T2389 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784820 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 784822 T2373 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784822 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 784823 T2337 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784823 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 784826 T2422 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784827 T2344 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784827 T2357 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784828 T2405 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 784837 T2423 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 784837 T2423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 785162 T2352 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:65486_y_ip%2Fpk_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 785162 T2352 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:65486_y_ip%252Fpk_collection1&state=recovering&nodeName=127.0.0.1:65486_y_ip%252Fpk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2093
[junit4:junit4] 2> 786174 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 786176 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65496_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65496/y_ip/pk"}
[junit4:junit4] 2> 786176 T2338 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 786176 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 786194 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786195 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786195 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786196 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786196 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786197 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786197 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 786932 T2423 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366\collection1
[junit4:junit4] 2> 786932 T2423 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 786933 T2423 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 786933 T2423 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 786936 T2423 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366\collection1\'
[junit4:junit4] 2> 786939 T2423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 786940 T2423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366/collection1/lib/README' to classloader
[junit4:junit4] 2> 787004 T2423 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 787076 T2423 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 787078 T2423 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 787084 T2423 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C375 name=collection1 org.apache.solr.core.SolrCore@80ae3e url=http://127.0.0.1:65486/y_ip/pk/collection1 node=127.0.0.1:65486_y_ip%2Fpk C375_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65486_y_ip%2Fpk, base_url=http://127.0.0.1:65486/y_ip/pk}
[junit4:junit4] 2> 787255 T2408 C375 P65486 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:65459/y_ip/pk/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 787256 T2408 C375 P65486 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65486/y_ip/pk START replicas=[http://127.0.0.1:65459/y_ip/pk/collection1/] nUpdates=100
[junit4:junit4] 2> 787258 T2408 C375 P65486 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 787258 T2408 C375 P65486 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 787258 T2408 C375 P65486 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 787259 T2408 C375 P65486 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 787259 T2408 C375 P65486 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 787259 T2408 C375 P65486 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:65459/y_ip/pk/collection1/. core=collection1
[junit4:junit4] 2> 787259 T2408 C375 P65486 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C376 name=collection1 org.apache.solr.core.SolrCore@14d8fa7 url=http://127.0.0.1:65459/y_ip/pk/collection1 node=127.0.0.1:65459_y_ip%2Fpk C376_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65459_y_ip%2Fpk, base_url=http://127.0.0.1:65459/y_ip/pk, leader=true}
[junit4:junit4] 2> 787282 T2351 C376 P65459 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 787286 T2348 C376 P65459 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 787293 T2351 C376 P65459 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 787296 T2351 C376 P65459 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 787303 T2351 C376 P65459 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 787304 T2351 C376 P65459 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 787308 T2351 C376 P65459 oass.SolrIndexSearcher.<init> Opening Searcher@8c90f8 realtime
[junit4:junit4] 2> 787308 T2351 C376 P65459 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 787309 T2351 C376 P65459 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ip/pk path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4] 2> 787312 T2408 C375 P65486 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 787312 T2408 C375 P65486 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 787317 T2349 C376 P65459 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 787317 T2349 C376 P65459 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 787319 T2408 C375 P65486 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 787319 T2408 C375 P65486 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 787319 T2408 C375 P65486 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 787326 T2350 C376 P65459 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=4
[junit4:junit4] 2> 787327 T2408 C375 P65486 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 787329 T2408 C375 P65486 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index.20130616033621626
[junit4:junit4] 2> 787333 T2408 C375 P65486 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index.20130616033621626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@664b3f fullCopy=false
[junit4:junit4] 2> 787337 T2352 C376 P65459 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 787341 T2408 C375 P65486 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 787348 T2408 C375 P65486 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 787349 T2408 C375 P65486 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 787357 T2408 C375 P65486 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 787359 T2408 C375 P65486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 787359 T2408 C375 P65486 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 787363 T2408 C375 P65486 oass.SolrIndexSearcher.<init> Opening Searcher@34134d main
[junit4:junit4] 2> 787364 T2407 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34134d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 787366 T2408 C375 P65486 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index.20130616033621626 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index.20130616033621626;done=true>>]
[junit4:junit4] 2> 787366 T2408 C375 P65486 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index.20130616033621626
[junit4:junit4] 2> 787366 T2408 C375 P65486 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty4\index.20130616033621626
[junit4:junit4] 2> 787368 T2408 C375 P65486 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 787369 T2408 C375 P65486 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 787369 T2408 C375 P65486 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 787369 T2408 C375 P65486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 787373 T2408 C375 P65486 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 787797 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 787798 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65486_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65486_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65486/y_ip/pk"}
[junit4:junit4] 2> 787816 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787817 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787818 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787818 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787817 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787819 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787819 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 787845 T2423 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 787858 T2423 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 787861 T2423 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 787887 T2423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 787902 T2423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 787908 T2423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 787914 T2423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 787914 T2423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 787915 T2423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 787917 T2423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 787917 T2423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 787918 T2423 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 787918 T2423 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371368177366\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty5\
[junit4:junit4] 2> 787918 T2423 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 787919 T2423 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 787921 T2423 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5
[junit4:junit4] 2> 787922 T2423 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty5\index/
[junit4:junit4] 2> 787923 T2423 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 787924 T2423 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index
[junit4:junit4] 2> 787933 T2423 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 787933 T2423 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 787937 T2423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 787937 T2423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 787938 T2423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 787939 T2423 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 787939 T2423 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 787939 T2423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 787945 T2423 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 787946 T2423 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 787946 T2423 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 787957 T2423 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 787968 T2423 oass.SolrIndexSearcher.<init> Opening Searcher@17cc9f3 main
[junit4:junit4] 2> 787971 T2423 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 787971 T2423 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 787975 T2426 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17cc9f3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 787978 T2423 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 787978 T2423 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65496/y_ip/pk collection:collection1 shard:shard2
[junit4:junit4] 2> 787985 T2423 oasc.ZkController.register We are http://127.0.0.1:65496/y_ip/pk/collection1/ and leader is http://127.0.0.1:65468/y_ip/pk/collection1/
[junit4:junit4] 2> 787986 T2423 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65496/y_ip/pk
[junit4:junit4] 2> 787986 T2423 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 787986 T2423 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C377 name=collection1 org.apache.solr.core.SolrCore@170b4d4 url=http://127.0.0.1:65496/y_ip/pk/collection1 node=127.0.0.1:65496_y_ip%2Fpk C377_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65496_y_ip%2Fpk, base_url=http://127.0.0.1:65496/y_ip/pk}
[junit4:junit4] 2> 787987 T2427 C377 P65496 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 787988 T2423 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 787988 T2427 C377 P65496 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 787988 T2427 C377 P65496 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 787988 T2427 C377 P65496 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 787991 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 787992 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 787993 T2427 C377 P65496 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 787993 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 788010 T2366 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:65496_y_ip%2Fpk_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 788457 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 788464 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65509
[junit4:junit4] 2> 788465 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 788466 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 788466 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304
[junit4:junit4] 2> 788466 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304\solr.xml
[junit4:junit4] 2> 788466 T2315 oasc.CoreContainer.<init> New CoreContainer 11015981
[junit4:junit4] 2> 788466 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304\'
[junit4:junit4] 2> 788466 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304\'
[junit4:junit4] 2> 788580 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 788580 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 788580 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 788581 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 788581 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 788581 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 788582 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 788582 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 788583 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 788583 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 788590 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 788591 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 788593 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 788595 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 788613 T2439 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bd7544 name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 788614 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 788618 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 788626 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 788633 T2441 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f21147 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 788633 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 788646 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 789406 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 789407 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65496_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65496_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65496/y_ip/pk"}
[junit4:junit4] 2> 789420 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789421 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789422 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789422 T2441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789423 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789425 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789426 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789427 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789698 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65509_y_ip%2Fpk
[junit4:junit4] 2> 789707 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65509_y_ip%2Fpk
[junit4:junit4] 2> 789712 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789713 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789715 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789716 T2441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789716 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 789720 T2389 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789721 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 789721 T2337 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789722 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 789723 T2373 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789723 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 789724 T2422 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789725 T2344 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789733 T2441 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789733 T2405 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789734 T2357 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 789739 T2442 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 789739 T2442 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 790103 T2366 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:65496_y_ip%2Fpk_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 790103 T2366 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:65496_y_ip%252Fpk_collection1&state=recovering&nodeName=127.0.0.1:65496_y_ip%252Fpk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2093
[junit4:junit4] 2> 791007 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 791009 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65509_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65509/y_ip/pk"}
[junit4:junit4] 2> 791009 T2338 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 791009 T2338 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 791025 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791026 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791027 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791027 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791027 T2441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791028 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791028 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791028 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 791834 T2442 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304\collection1
[junit4:junit4] 2> 791834 T2442 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 791835 T2442 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 791836 T2442 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 791838 T2442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304\collection1\'
[junit4:junit4] 2> 791839 T2442 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 791841 T2442 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304/collection1/lib/README' to classloader
[junit4:junit4] 2> 791912 T2442 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 792008 T2442 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 792011 T2442 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 792019 T2442 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> C377_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65496_y_ip%2Fpk, base_url=http://127.0.0.1:65496/y_ip/pk}
[junit4:junit4] 2> 792197 T2427 C377 P65496 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:65468/y_ip/pk/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 792198 T2427 C377 P65496 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65496/y_ip/pk START replicas=[http://127.0.0.1:65468/y_ip/pk/collection1/] nUpdates=100
[junit4:junit4] 2> 792198 T2427 C377 P65496 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 792198 T2427 C377 P65496 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 792199 T2427 C377 P65496 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 792199 T2427 C377 P65496 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 792199 T2427 C377 P65496 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 792199 T2427 C377 P65496 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:65468/y_ip/pk/collection1/. core=collection1
[junit4:junit4] 2> 792199 T2427 C377 P65496 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C378 name=collection1 org.apache.solr.core.SolrCore@1c5fada url=http://127.0.0.1:65468/y_ip/pk/collection1 node=127.0.0.1:65468_y_ip%2Fpk C378_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65468_y_ip%2Fpk, base_url=http://127.0.0.1:65468/y_ip/pk, leader=true}
[junit4:junit4] 2> 792214 T2367 C378 P65468 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 792216 T2368 C378 P65468 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> ASYNC NEW_CORE C379 name=collection1 org.apache.solr.core.SolrCore@1c5fada url=http://127.0.0.1:65468/y_ip/pk/collection1 node=127.0.0.1:65468_y_ip%2Fpk C379_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65468_y_ip%2Fpk, base_url=http://127.0.0.1:65468/y_ip/pk, leader=true}
[junit4:junit4] 2> 792244 T2367 C379 P65468 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 792246 T2367 C379 P65468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 792261 T2367 C379 P65468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 792261 T2367 C379 P65468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 792267 T2367 C379 P65468 oass.SolrIndexSearcher.<init> Opening Searcher@19c7738 realtime
[junit4:junit4] 2> 792267 T2367 C379 P65468 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 792267 T2367 C379 P65468 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ip/pk path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 54
[junit4:junit4] 2> ASYNC NEW_CORE C380 name=collection1 org.apache.solr.core.SolrCore@170b4d4 url=http://127.0.0.1:65496/y_ip/pk/collection1 node=127.0.0.1:65496_y_ip%2Fpk C380_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65496_y_ip%2Fpk, base_url=http://127.0.0.1:65496/y_ip/pk}
[junit4:junit4] 2> 792269 T2427 C380 P65496 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 792269 T2427 C380 P65496 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 792273 T2364 C379 P65468 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 792273 T2364 C379 P65468 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 792274 T2427 C380 P65496 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 792274 T2427 C380 P65496 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 792274 T2427 C380 P65496 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 792287 T2365 C379 P65468 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=11
[junit4:junit4] 2> 792288 T2427 C380 P65496 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 792290 T2427 C380 P65496 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index.20130616033626587
[junit4:junit4] 2> 792291 T2427 C380 P65496 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index.20130616033626587 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10f65b1 fullCopy=false
[junit4:junit4] 2> 792295 T2366 C379 P65468 oasc.SolrCore.execute [collection1] webapp=/y_ip/pk path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 792297 T2427 C380 P65496 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 792306 T2427 C380 P65496 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 792306 T2427 C380 P65496 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 792312 T2427 C380 P65496 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 792313 T2427 C380 P65496 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 792313 T2427 C380 P65496 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 792315 T2427 C380 P65496 oass.SolrIndexSearcher.<init> Opening Searcher@3ff2ad main
[junit4:junit4] 2> 792317 T2426 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ff2ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 792317 T2427 C380 P65496 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index.20130616033626587 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index.20130616033626587;done=true>>]
[junit4:junit4] 2> 792317 T2427 C380 P65496 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index.20130616033626587
[junit4:junit4] 2> 792317 T2427 C380 P65496 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty5\index.20130616033626587
[junit4:junit4] 2> 792319 T2427 C380 P65496 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 792319 T2427 C380 P65496 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 792319 T2427 C380 P65496 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 792319 T2427 C380 P65496 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 792324 T2427 C380 P65496 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 792614 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 792616 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65496_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65496_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65496/y_ip/pk"}
[junit4:junit4] 2> 792631 T2357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792632 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792632 T2441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792632 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792633 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792633 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792633 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 792633 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 793343 T2442 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 793361 T2442 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 793368 T2442 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 793400 T2442 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 793425 T2442 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 793434 T2442 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 793436 T2442 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 793436 T2442 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 793437 T2442 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 793439 T2442 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 793439 T2442 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 793441 T2442 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 793441 T2442 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371368182304\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty6\
[junit4:junit4] 2> 793442 T2442 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b6f4ea
[junit4:junit4] 2> 793442 T2442 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 793444 T2442 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty6
[junit4:junit4] 2> 793446 T2442 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927/jetty6\index/
[junit4:junit4] 2> 793448 T2442 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty6\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 793448 T2442 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty6\index
[junit4:junit4] 2> 793462 T2442 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty6\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 793462 T2442 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 793468 T2442 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 793468 T2442 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 793469 T2442 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 793470 T2442 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 793471 T2442 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 793471 T2442 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 793481 T2442 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 793482 T2442 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 793483 T2442 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 793504 T2442 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 793524 T2442 oass.SolrIndexSearcher.<init> Opening Searcher@5cf7d1 main
[junit4:junit4] 2> 793527 T2442 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 793527 T2442 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 793537 T2445 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cf7d1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 793541 T2442 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 793541 T2442 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65509/y_ip/pk collection:collection1 shard:shard3
[junit4:junit4] 2> 793551 T2442 oasc.ZkController.register We are http://127.0.0.1:65509/y_ip/pk/collection1/ and leader is http://127.0.0.1:65477/y_ip/pk/collection1/
[junit4:junit4] 2> 793552 T2442 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65509/y_ip/pk
[junit4:junit4] 2> 793552 T2442 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 793553 T2442 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C381 name=collection1 org.apache.solr.core.SolrCore@1eb7a7e url=http://127.0.0.1:65509/y_ip/pk/collection1 node=127.0.0.1:65509_y_ip%2Fpk C381_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65509_y_ip%2Fpk, base_url=http://127.0.0.1:65509/y_ip/pk}
[junit4:junit4] 2> 793554 T2446 C381 P65509 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 793555 T2446 C381 P65509 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 793555 T2446 C381 P65509 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 793556 T2446 C381 P65509 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 793555 T2442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 793561 T2446 C381 P65509 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 793563 T2315 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 793563 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 793564 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 793582 T2381 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:65509_y_ip%2Fpk_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 794124 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 794133 T2315 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65522
[junit4:junit4] 2> 794134 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 794135 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 794135 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371368187879
[junit4:junit4] 2> 794135 T2315 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371368187879\solr.xml
[junit4:junit4] 2> 794136 T2315 oasc.CoreContainer.<init> New CoreContainer 1880947
[junit4:junit4] 2> 794136 T2315 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371368187879\'
[junit4:junit4] 2> 794137 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371368187879\'
[junit4:junit4] 2> 794263 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 794263 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 794265 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 794266 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 794266 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 794266 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 794266 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 794268 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 794268 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 794269 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 794284 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 794284 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65440/solr
[junit4:junit4] 2> 794287 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 794290 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 794314 T2458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e22af3 name:ZooKeeperConnection Watcher:127.0.0.1:65440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 794315 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 794322 T2315 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 794322 T2317 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4be9579a0011, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 794331 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 794336 T2460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4259e0 name:ZooKeeperConnection Watcher:127.0.0.1:65440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 794336 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 794351 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 794362 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 794363 T2338 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65509_y_ip%2Fpk_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65509_y_ip%2Fpk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65509/y_ip/pk"}
[junit4:junit4] 2> 794379 T2460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794380 T2344 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794381 T2422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794382 T2373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794382 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794384 T2405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794386 T2389 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 794388 T2441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[jun
[...truncated too long message...]
umulative_adds=165,cumulative_deletesById=81,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 913590 T2315 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 913590 T2315 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 913590 T2315 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 913594 T2315 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 913594 T2315 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 913595 T2315 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty12\index.20130616033701994 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty12\index.20130616033701994;done=false>>]
[junit4:junit4] 2> 913595 T2315 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty12\index.20130616033701994
[junit4:junit4] 2> 913595 T2315 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty12 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty12;done=false>>]
[junit4:junit4] 2> 913596 T2315 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\jetty12
[junit4:junit4] 2> 913596 T2752 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89873983139872800-127.0.0.1:49202_y_ip%2Fpk-n_0000000014) am no longer a leader.
[junit4:junit4] 2> 913600 T2623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 913601 T2623 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 913601 T2623 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 913613 T2315 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/y_ip/pk,null}
[junit4:junit4] 2> 913780 T2668 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 913780 T2668 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\zookeeper\server1\data\version-2\log.1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\zookeeper\server1\data\version-2 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\zookeeper\server1\data FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\zookeeper\server1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927\zookeeper FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371368150927 FAILED !!!!!
[junit4:junit4] 2> 914086 T2315 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 914089 T2315 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:65440 65440
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.method=testDistribSearch -Dtests.seed=C0F2EFD4734535B9 -Dtests.slow=true -Dtests.locale=ar_OM -Dtests.timezone=America/Dominica -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 159s | ChaosMonkeySafeLeaderTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard2 is not consistent. Got 132 from http://127.0.0.1:65468/y_ip/pk/collection1lastClient and got 117 from http://127.0.0.1:65496/y_ip/pk/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C0F2EFD4734535B9:411461CC041A5585]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 916105 T2315 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=ar_OM, timezone=America/Dominica
[junit4:junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_21 (32-bit)/cpus=2,threads=2,free=23625824,total=260636672
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SpellPossibilityIteratorTest, ZkSolrClientTest, CircularListTest, RecoveryZkTest, ResourceLoaderTest, UniqFieldsUpdateProcessorFactoryTest, RequiredFieldsTest, ChaosMonkeyNothingIsSafeTest, TestClassNameShortening, TestAddFieldRealTimeGet, TestFoldingMultitermQuery, TestQueryTypes, SolrCoreCheckLockOnStartupTest, XmlUpdateRequestHandlerTest, TestCollationField, DistributedQueryElevationComponentTest, TestCloudManagedSchema, TestLRUCache, SolrInfoMBeanTest, QueryParsingTest, TestStressLucene, MultiTermTest, TestFunctionQuery, CurrencyFieldXmlFileTest, ScriptEngineTest, UUIDFieldTest, LoggingHandlerTest, ClusterStateTest, TestSurroundQueryParser, CachingDirectoryFactoryTest, StatelessScriptUpdateProcessorFactoryTest, SoftAutoCommitTest, AnalysisAfterCoreReloadTest, MinimalSchemaTest, TestSchemaSimilarityResource, TestSort, TestJmxIntegration, HighlighterTest, TestReversedWildcardFilterFactory, TestHashPartitioner, SuggesterTest, TestMultiCoreConfBootstrap, ChaosMonkeyShardSplitTest, TestPseudoReturnFields, SuggesterTSTTest, TestNumberUtils, TestCloudManagedSchemaAddField, BadCopyFieldTest, ReturnFieldsTest, TestMaxScoreQueryParser, TestSchemaResource, TestFaceting, TestReplicationHandler, TestIBSimilarityFactory, TestFieldTypeCollectionResource, TestIndexSearcher, TestSchemaVersionResource, DirectUpdateHandlerOptimizeTest, SpellCheckCollatorTest, SearchHandlerTest, SuggesterFSTTest, DistributedTermsComponentTest, TestCodecSupport, SynonymTokenizerTest, TestIndexingPerformance, TestManagedSchema, UpdateRequestProcessorFactoryTest, ResponseLogComponentTest, TestPHPSerializedResponseWriter, CurrencyFieldOpenExchangeTest, TestZkChroot, TestWordDelimiterFilterFactory, SOLR749Test, TestFastLRUCache, TestPostingsSolrHighlighter, TestAnalyzedSuggestions, TestQuerySenderListener, DocumentAnalysisRequestHandlerTest, TestShardHandlerFactory, BasicZkTest, SolrIndexConfigTest, DirectUpdateHandlerTest, TestLMJelinekMercerSimilarityFactory, TestCoreDiscovery, TestJmxMonitoredMap, RegexBoostProcessorTest, TestPartialUpdateDeduplication, TestSolrIndexConfig, CollectionsAPIDistributedZkTest, SolrPluginUtilsTest, DirectSolrSpellCheckerTest, ZkNodePropsTest, TestSolrQueryParserResource, ChaosMonkeySafeLeaderTest]
[junit4:junit4] Completed in 159.52s, 1 test, 1 failure <<< FAILURES!
[...truncated 624 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 failure, 18 ignored (12 assumptions)
Total time: 66 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_21) - Build #
2903 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2903/
Java: 32bit/jdk1.7.0_21 -server -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard3 is not consistent. Got 4 from http://127.0.0.1:55008/collection1lastClient and got 2 from http://127.0.0.1:55041/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 4 from http://127.0.0.1:55008/collection1lastClient and got 2 from http://127.0.0.1:55041/collection1
at __randomizedtesting.SeedInfo.seed([E5D0D5F06ED66AB1:64365BE819890A8D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:53613/s_k/collection1lastClient and got 252 from http://127.0.0.1:53632/s_k/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:53613/s_k/collection1lastClient and got 252 from http://127.0.0.1:53632/s_k/collection1
at __randomizedtesting.SeedInfo.seed([E5D0D5F06ED66AB1:64365BE819890A8D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9434 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 526739 T1210 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /s_k/
[junit4:junit4] 2> 526744 T1210 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-SyncSliceTest-1371546351362
[junit4:junit4] 2> 526747 T1210 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 526748 T1211 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 526858 T1210 oasc.ZkTestServer.run start zk server on port:53594
[junit4:junit4] 2> 526861 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 526873 T1217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53bbf7 name:ZooKeeperConnection Watcher:127.0.0.1:53594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 526873 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 526873 T1210 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 526884 T1212 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5688770c0000, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 526887 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 526891 T1219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10eb6bb name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 526892 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 526892 T1210 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 526900 T1210 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 526905 T1210 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 526910 T1210 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 526916 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 526917 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 526928 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 526928 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 526934 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 526934 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 526939 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 526939 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 526947 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 526947 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 526952 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 526952 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 526960 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 526961 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 526966 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 526966 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 526973 T1210 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 526973 T1210 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 527465 T1210 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 527481 T1210 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53601
[junit4:junit4] 2> 527481 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 527482 T1210 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 527482 T1210 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597
[junit4:junit4] 2> 527482 T1210 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597\solr.xml
[junit4:junit4] 2> 527482 T1210 oasc.CoreContainer.<init> New CoreContainer 2746665
[junit4:junit4] 2> 527483 T1210 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597\'
[junit4:junit4] 2> 527483 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597\'
[junit4:junit4] 2> 527607 T1210 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 527608 T1210 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 527608 T1210 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 527608 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 527608 T1210 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 527609 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 527609 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 527609 T1210 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 527609 T1210 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 527610 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 527622 T1210 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 527623 T1210 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53594/solr
[junit4:junit4] 2> 527623 T1210 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 527625 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 527640 T1230 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d27749 name:ZooKeeperConnection Watcher:127.0.0.1:53594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 527642 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 527646 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 527655 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 527659 T1232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78417e name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 527659 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 527663 T1210 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 527673 T1210 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 527681 T1210 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 527685 T1210 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53601_s_k
[junit4:junit4] 2> 527688 T1210 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53601_s_k
[junit4:junit4] 2> 527695 T1210 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 527709 T1210 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 527714 T1210 oasc.Overseer.start Overseer (id=89885661683515395-127.0.0.1:53601_s_k-n_0000000000) starting
[junit4:junit4] 2> 527724 T1210 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 527733 T1234 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 527735 T1210 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 527741 T1210 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 527745 T1210 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 527752 T1233 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 527766 T1235 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 527766 T1235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 529419 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 529420 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53601_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53601/s_k"}
[junit4:junit4] 2> 529421 T1233 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 529421 T1233 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 529435 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 529969 T1235 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597\collection1
[junit4:junit4] 2> 529969 T1235 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 529971 T1235 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 529971 T1235 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 529975 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597\collection1\'
[junit4:junit4] 2> 529979 T1235 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 529981 T1235 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597/collection1/lib/README' to classloader
[junit4:junit4] 2> 530073 T1235 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 530178 T1235 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 530182 T1235 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 530192 T1235 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 531047 T1235 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 531060 T1235 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 531065 T1235 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 531098 T1235 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 531104 T1235 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 531112 T1235 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 531114 T1235 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 531114 T1235 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 531114 T1235 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 531118 T1235 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 531118 T1235 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 531118 T1235 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 531157 T1235 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371546351597\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/control/data\
[junit4:junit4] 2> 531158 T1235 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2143e4
[junit4:junit4] 2> 531158 T1235 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 531159 T1235 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data
[junit4:junit4] 2> 531159 T1235 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/control/data\index/
[junit4:junit4] 2> 531161 T1235 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 531161 T1235 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index
[junit4:junit4] 2> 531182 T1235 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1688f5c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 531182 T1235 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 531187 T1235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 531187 T1235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 531188 T1235 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 531188 T1235 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 531189 T1235 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 531189 T1235 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 531189 T1235 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 531190 T1235 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 531190 T1235 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 531203 T1235 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 531215 T1235 oass.SolrIndexSearcher.<init> Opening Searcher@8d808f main
[junit4:junit4] 2> 531218 T1235 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 531218 T1235 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 531223 T1236 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8d808f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 531224 T1235 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 531224 T1235 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53601/s_k collection:control_collection shard:shard1
[junit4:junit4] 2> 531227 T1235 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 531249 T1235 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 531257 T1235 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 531257 T1235 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 531257 T1235 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53601/s_k/collection1/
[junit4:junit4] 2> 531258 T1235 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 531258 T1235 oasc.SyncStrategy.syncToMe http://127.0.0.1:53601/s_k/collection1/ has no replicas
[junit4:junit4] 2> 531258 T1235 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53601/s_k/collection1/
[junit4:junit4] 2> 531258 T1235 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 532751 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 532786 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 532841 T1235 oasc.ZkController.register We are http://127.0.0.1:53601/s_k/collection1/ and leader is http://127.0.0.1:53601/s_k/collection1/
[junit4:junit4] 2> 532841 T1235 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53601/s_k
[junit4:junit4] 2> 532842 T1235 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 532842 T1235 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 532842 T1235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 532848 T1235 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 532851 T1210 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 532852 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 532852 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 532869 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 532873 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 532879 T1239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1243701 name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 532880 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 532883 T1210 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 532889 T1210 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 533550 T1210 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 533566 T1210 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53613
[junit4:junit4] 2> 533567 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 533568 T1210 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 533568 T1210 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507
[junit4:junit4] 2> 533569 T1210 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507\solr.xml
[junit4:junit4] 2> 533571 T1210 oasc.CoreContainer.<init> New CoreContainer 15375704
[junit4:junit4] 2> 533571 T1210 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507\'
[junit4:junit4] 2> 533572 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507\'
[junit4:junit4] 2> 533755 T1210 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 533756 T1210 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 533757 T1210 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 533757 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 533757 T1210 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 533759 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 533759 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 533760 T1210 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 533760 T1210 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 533761 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 533778 T1210 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 533778 T1210 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53594/solr
[junit4:junit4] 2> 533779 T1210 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 533782 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 533804 T1250 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32339a name:ZooKeeperConnection Watcher:127.0.0.1:53594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 533805 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 533811 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 533812 T1212 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5688770c0005, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 533826 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 533830 T1252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9f3e name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 533832 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 533843 T1210 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 534394 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 534396 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53601_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53601/s_k"}
[junit4:junit4] 2> 534409 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 534410 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 534412 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 534844 T1210 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53613_s_k
[junit4:junit4] 2> 534847 T1210 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53613_s_k
[junit4:junit4] 2> 534855 T1252 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 534856 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 534855 T1239 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 534856 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 534856 T1232 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 534857 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 534882 T1253 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 534883 T1253 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 535910 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 535911 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53613_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53613/s_k"}
[junit4:junit4] 2> 535911 T1233 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 535911 T1233 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 535936 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 535937 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 535937 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 536869 T1253 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507\collection1
[junit4:junit4] 2> 536869 T1253 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 536871 T1253 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 536871 T1253 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 536874 T1253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507\collection1\'
[junit4:junit4] 2> 536876 T1253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 536876 T1253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507/collection1/lib/README' to classloader
[junit4:junit4] 2> 536929 T1253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 537021 T1253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 537024 T1253 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 537032 T1253 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 537803 T1253 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 537823 T1253 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 537829 T1253 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 537858 T1253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 537865 T1253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 537873 T1253 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 537876 T1253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 537877 T1253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 537877 T1253 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 537880 T1253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 537880 T1253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 537880 T1253 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 537881 T1253 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371546357507\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty1\
[junit4:junit4] 2> 537881 T1253 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2143e4
[junit4:junit4] 2> 537881 T1253 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 537882 T1253 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1
[junit4:junit4] 2> 537883 T1253 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty1\index/
[junit4:junit4] 2> 537884 T1253 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 537884 T1253 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index
[junit4:junit4] 2> 537898 T1253 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 537898 T1253 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 537902 T1253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 537902 T1253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 537903 T1253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 537904 T1253 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 537904 T1253 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 537904 T1253 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 537905 T1253 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 537905 T1253 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 537906 T1253 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 537916 T1253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 537926 T1253 oass.SolrIndexSearcher.<init> Opening Searcher@19c7b65 main
[junit4:junit4] 2> 537928 T1253 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 537928 T1253 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 537935 T1254 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19c7b65 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 537937 T1253 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 537937 T1253 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53613/s_k collection:collection1 shard:shard1
[junit4:junit4] 2> 537939 T1253 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 538033 T1253 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 538042 T1253 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 538042 T1253 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 538042 T1253 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 538042 T1253 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 538042 T1253 oasc.SyncStrategy.syncToMe http://127.0.0.1:53613/s_k/collection1/ has no replicas
[junit4:junit4] 2> 538042 T1253 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 538043 T1253 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 538924 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 538954 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 538954 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 538955 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 538963 T1253 oasc.ZkController.register We are http://127.0.0.1:53613/s_k/collection1/ and leader is http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 538963 T1253 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53613/s_k
[junit4:junit4] 2> 538963 T1253 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 538964 T1253 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 538965 T1253 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 538973 T1253 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 538976 T1210 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 538977 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 538988 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 539519 T1210 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 539526 T1210 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53622
[junit4:junit4] 2> 539528 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 539528 T1210 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 539529 T1210 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613
[junit4:junit4] 2> 539529 T1210 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613\solr.xml
[junit4:junit4] 2> 539530 T1210 oasc.CoreContainer.<init> New CoreContainer 12952954
[junit4:junit4] 2> 539530 T1210 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613\'
[junit4:junit4] 2> 539531 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613\'
[junit4:junit4] 2> 539699 T1210 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 539700 T1210 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 539701 T1210 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 539701 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 539701 T1210 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 539702 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 539702 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 539703 T1210 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 539703 T1210 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 539704 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 539719 T1210 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 539719 T1210 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53594/solr
[junit4:junit4] 2> 539721 T1210 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 539723 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 539740 T1266 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f299df name:ZooKeeperConnection Watcher:127.0.0.1:53594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 539741 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 539747 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 539755 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 539760 T1268 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e322bb name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 539760 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 539770 T1210 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 540463 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 540465 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53613_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53613/s_k"}
[junit4:junit4] 2> 540480 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540480 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540481 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540482 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540765 T1210 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53622_s_k
[junit4:junit4] 2> 540768 T1210 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53622_s_k
[junit4:junit4] 2> 540776 T1239 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 540776 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 540777 T1252 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 540777 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 540778 T1268 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 540778 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 540779 T1232 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 540780 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 540794 T1269 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 540794 T1269 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 541990 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 541990 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53622_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53622/s_k"}
[junit4:junit4] 2> 541990 T1233 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 541990 T1233 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 542003 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 542004 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 542004 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 542005 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 542776 T1269 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613\collection1
[junit4:junit4] 2> 542776 T1269 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 542777 T1269 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 542777 T1269 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 542781 T1269 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613\collection1\'
[junit4:junit4] 2> 542783 T1269 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 542783 T1269 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613/collection1/lib/README' to classloader
[junit4:junit4] 2> 542845 T1269 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 542915 T1269 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 542919 T1269 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 542923 T1269 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 543809 T1269 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 543824 T1269 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 543830 T1269 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 543856 T1269 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 543863 T1269 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 543871 T1269 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 543872 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 543872 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 543873 T1269 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 543875 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 543876 T1269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 543876 T1269 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 543876 T1269 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371546363613\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty2\
[junit4:junit4] 2> 543876 T1269 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2143e4
[junit4:junit4] 2> 543877 T1269 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 543878 T1269 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2
[junit4:junit4] 2> 543879 T1269 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty2\index/
[junit4:junit4] 2> 543881 T1269 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 543881 T1269 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index
[junit4:junit4] 2> 543895 T1269 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 543895 T1269 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 543900 T1269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 543900 T1269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 543902 T1269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 543903 T1269 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 543904 T1269 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 543904 T1269 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 543904 T1269 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 543904 T1269 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 543905 T1269 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 543920 T1269 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 543935 T1269 oass.SolrIndexSearcher.<init> Opening Searcher@1857f06 main
[junit4:junit4] 2> 543938 T1269 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 543938 T1269 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 543944 T1270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1857f06 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 543947 T1269 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 543948 T1269 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53622/s_k collection:collection1 shard:shard1
[junit4:junit4] 2> 543956 T1269 oasc.ZkController.register We are http://127.0.0.1:53622/s_k/collection1/ and leader is http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 543956 T1269 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53622/s_k
[junit4:junit4] 2> 543956 T1269 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 543957 T1269 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2603 name=collection1 org.apache.solr.core.SolrCore@1dffda9 url=http://127.0.0.1:53622/s_k/collection1 node=127.0.0.1:53622_s_k C2603_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53622_s_k, base_url=http://127.0.0.1:53622/s_k}
[junit4:junit4] 2> 543958 T1271 C2603 P53622 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 543958 T1271 C2603 P53622 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 543959 T1271 C2603 P53622 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 543959 T1271 C2603 P53622 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 543959 T1269 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 543963 T1271 C2603 P53622 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 543966 T1210 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 543966 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 543967 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 543979 T1246 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 544394 T1210 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 544400 T1210 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53632
[junit4:junit4] 2> 544401 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 544402 T1210 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 544402 T1210 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593
[junit4:junit4] 2> 544403 T1210 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593\solr.xml
[junit4:junit4] 2> 544403 T1210 oasc.CoreContainer.<init> New CoreContainer 28872346
[junit4:junit4] 2> 544404 T1210 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593\'
[junit4:junit4] 2> 544404 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593\'
[junit4:junit4] 2> 544556 T1210 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 544556 T1210 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 544557 T1210 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 544557 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 544558 T1210 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 544559 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 544559 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 544559 T1210 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 544560 T1210 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 544560 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 544572 T1210 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 544573 T1210 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53594/solr
[junit4:junit4] 2> 544573 T1210 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 544576 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 544592 T1283 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ee441 name:ZooKeeperConnection Watcher:127.0.0.1:53594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 544594 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 544599 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 544610 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 544615 T1285 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e6e25 name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 544615 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 544626 T1210 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 544867 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 544868 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53622_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53622/s_k"}
[junit4:junit4] 2> 544883 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544884 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544885 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544885 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544885 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 545524 T1210 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53632_s_k
[junit4:junit4] 2> 545526 T1210 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53632_s_k
[junit4:junit4] 2> 545531 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 545532 T1252 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 545532 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 545533 T1232 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 545534 T1239 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 545534 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 545534 T1268 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 545536 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 545534 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 545538 T1285 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 545551 T1286 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 545551 T1286 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 545762 T1246 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 545762 T1246 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=3&state=recovering&nodeName=127.0.0.1:53622_s_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1783
[junit4:junit4] 2> 546238 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 546240 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53632_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53632/s_k"}
[junit4:junit4] 2> 546240 T1233 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 546240 T1233 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 546254 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 546255 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 546255 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 546255 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 546255 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 546444 T1286 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593\collection1
[junit4:junit4] 2> 546444 T1286 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 546445 T1286 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 546446 T1286 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 546449 T1286 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593\collection1\'
[junit4:junit4] 2> 546450 T1286 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 546450 T1286 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593/collection1/lib/README' to classloader
[junit4:junit4] 2> 546506 T1286 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 546566 T1286 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 546577 T1286 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 546584 T1286 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 547263 T1286 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 547280 T1286 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 547284 T1286 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 547316 T1286 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 547321 T1286 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 547327 T1286 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 547329 T1286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 547330 T1286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 547330 T1286 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 547332 T1286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 547332 T1286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 547332 T1286 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 547333 T1286 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371546368593\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty3\
[junit4:junit4] 2> 547333 T1286 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2143e4
[junit4:junit4] 2> 547333 T1286 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 547334 T1286 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3
[junit4:junit4] 2> 547334 T1286 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty3\index/
[junit4:junit4] 2> 547335 T1286 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 547335 T1286 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index
[junit4:junit4] 2> 547347 T1286 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 547347 T1286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 547351 T1286 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 547351 T1286 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 547352 T1286 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 547353 T1286 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 547353 T1286 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 547353 T1286 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 547354 T1286 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 547354 T1286 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 547354 T1286 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 547365 T1286 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 547374 T1286 oass.SolrIndexSearcher.<init> Opening Searcher@1b8dbeb main
[junit4:junit4] 2> 547375 T1286 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 547375 T1286 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 547380 T1287 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b8dbeb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 547381 T1286 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 547381 T1286 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53632/s_k collection:collection1 shard:shard1
[junit4:junit4] 2> 547387 T1286 oasc.ZkController.register We are http://127.0.0.1:53632/s_k/collection1/ and leader is http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 547387 T1286 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53632/s_k
[junit4:junit4] 2> 547387 T1286 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 547387 T1286 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2604 name=collection1 org.apache.solr.core.SolrCore@1cbfd8e url=http://127.0.0.1:53632/s_k/collection1 node=127.0.0.1:53632_s_k C2604_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53632_s_k, base_url=http://127.0.0.1:53632/s_k}
[junit4:junit4] 2> 547388 T1288 C2604 P53632 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 547389 T1286 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 547389 T1288 C2604 P53632 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 547390 T1288 C2604 P53632 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 547390 T1288 C2604 P53632 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 547392 T1210 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 547393 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 547394 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 547394 T1288 C2604 P53632 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 547407 T1243 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> ASYNC NEW_CORE C2605 name=collection1 org.apache.solr.core.SolrCore@1dffda9 url=http://127.0.0.1:53622/s_k/collection1 node=127.0.0.1:53622_s_k C2605_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53622_s_k, base_url=http://127.0.0.1:53622/s_k}
[junit4:junit4] 2> 547546 T1271 C2605 P53622 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53613/s_k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 547546 T1271 C2605 P53622 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53622/s_k START replicas=[http://127.0.0.1:53613/s_k/collection1/] nUpdates=100
[junit4:junit4] 2> 547549 T1271 C2605 P53622 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 547549 T1271 C2605 P53622 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 547549 T1271 C2605 P53622 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 547549 T1271 C2605 P53622 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 547550 T1271 C2605 P53622 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 547550 T1271 C2605 P53622 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53613/s_k/collection1/. core=collection1
[junit4:junit4] 2> 547551 T1271 C2605 P53622 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2606 name=collection1 org.apache.solr.core.SolrCore@12c3f84 url=http://127.0.0.1:53613/s_k/collection1 node=127.0.0.1:53613_s_k C2606_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53613_s_k, base_url=http://127.0.0.1:53613/s_k, leader=true}
[junit4:junit4] 2> 547595 T1248 C2606 P53613 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 547596 T1246 C2606 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 547602 T1248 C2606 P53613 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 547602 T1248 C2606 P53613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 547610 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 547611 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53632_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53632/s_k"}
[junit4:junit4] 2> 547618 T1248 C2606 P53613 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 547618 T1248 C2606 P53613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 547622 T1248 C2606 P53613 oass.SolrIndexSearcher.<init> Opening Searcher@794e41 realtime
[junit4:junit4] 2> 547622 T1248 C2606 P53613 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 547622 T1248 C2606 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 28
[junit4:junit4] 2> 547623 T1271 C2605 P53622 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 547624 T1271 C2605 P53622 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 547628 T1245 C2606 P53613 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 547628 T1245 C2606 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 547629 T1271 C2605 P53622 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 547629 T1271 C2605 P53622 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 547629 T1271 C2605 P53622 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 547635 T1247 C2606 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=3
[junit4:junit4] 2> 547635 T1271 C2605 P53622 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 547638 T1271 C2605 P53622 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index.20130618050612252
[junit4:junit4] 2> 547641 T1271 C2605 P53622 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index.20130618050612252 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ef8b10; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 547645 T1246 C2606 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 547648 T1271 C2605 P53622 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 547658 T1271 C2605 P53622 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 547658 T1271 C2605 P53622 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 547666 T1271 C2605 P53622 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 547667 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 547667 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 547667 T1271 C2605 P53622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 547668 T1271 C2605 P53622 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 547669 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 547670 T1271 C2605 P53622 oass.SolrIndexSearcher.<init> Opening Searcher@f9d6cc main
[junit4:junit4] 2> 547675 T1270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f9d6cc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 547677 T1271 C2605 P53622 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index.20130618050612252 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index.20130618050612252;done=true>>]
[junit4:junit4] 2> 547677 T1271 C2605 P53622 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index.20130618050612252
[junit4:junit4] 2> 547677 T1271 C2605 P53622 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index.20130618050612252
[junit4:junit4] 2> 547679 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 547680 T1271 C2605 P53622 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 547680 T1271 C2605 P53622 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 547680 T1271 C2605 P53622 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 547681 T1271 C2605 P53622 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 547680 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 547689 T1271 C2605 P53622 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 547768 T1210 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 547772 T1210 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53645
[junit4:junit4] 2> 547773 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 547774 T1210 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 547774 T1210 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023
[junit4:junit4] 2> 547775 T1210 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023\solr.xml
[junit4:junit4] 2> 547776 T1210 oasc.CoreContainer.<init> New CoreContainer 10170464
[junit4:junit4] 2> 547776 T1210 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023\'
[junit4:junit4] 2> 547776 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023\'
[junit4:junit4] 2> 547906 T1210 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 547906 T1210 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 547906 T1210 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 547906 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 547906 T1210 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 547907 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 547908 T1210 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 547908 T1210 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 547908 T1210 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 547908 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 547920 T1210 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 547921 T1210 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53594/solr
[junit4:junit4] 2> 547922 T1210 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 547923 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 547935 T1302 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13dcdf4 name:ZooKeeperConnection Watcher:127.0.0.1:53594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 547936 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 547941 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 547941 T1212 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5688770c000b, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 547952 T1210 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 547957 T1304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@145803e name:ZooKeeperConnection Watcher:127.0.0.1:53594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 547957 T1210 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 547969 T1210 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 548298 T1243 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 548298 T1243 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:53632_s_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=891
[junit4:junit4] 2> 548867 T1210 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53645_s_k
[junit4:junit4] 2> 548874 T1210 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53645_s_k
[junit4:junit4] 2> 548878 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 548881 T1239 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 548881 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 548882 T1304 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 548883 T1252 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 548884 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 548884 T1232 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 548885 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 548886 T1268 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 548886 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 548887 T1285 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 548900 T1305 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 548900 T1305 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 549038 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 549039 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53622_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53622/s_k"}
[junit4:junit4] 2> 549049 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53645_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53645/s_k"}
[junit4:junit4] 2> 549050 T1233 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 549050 T1233 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 549061 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 549062 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 549062 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 549063 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 549063 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 549063 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 549793 T1305 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023\collection1
[junit4:junit4] 2> 549793 T1305 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 549795 T1305 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 549795 T1305 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 549797 T1305 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023\collection1\'
[junit4:junit4] 2> 549799 T1305 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 549800 T1305 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023/collection1/lib/README' to classloader
[junit4:junit4] 2> 549883 T1305 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 549972 T1305 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 549974 T1305 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 549982 T1305 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C2607 name=collection1 org.apache.solr.core.SolrCore@1cbfd8e url=http://127.0.0.1:53632/s_k/collection1 node=127.0.0.1:53632_s_k C2607_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53632_s_k, base_url=http://127.0.0.1:53632/s_k}
[junit4:junit4] 2> 550081 T1288 C2607 P53632 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53613/s_k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 550081 T1288 C2607 P53632 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53632/s_k START replicas=[http://127.0.0.1:53613/s_k/collection1/] nUpdates=100
[junit4:junit4] 2> 550082 T1288 C2607 P53632 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 550083 T1288 C2607 P53632 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 550083 T1288 C2607 P53632 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 550084 T1288 C2607 P53632 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 550084 T1288 C2607 P53632 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 550084 T1288 C2607 P53632 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53613/s_k/collection1/. core=collection1
[junit4:junit4] 2> 550084 T1288 C2607 P53632 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2608 name=collection1 org.apache.solr.core.SolrCore@12c3f84 url=http://127.0.0.1:53613/s_k/collection1 node=127.0.0.1:53613_s_k C2608_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53613_s_k, base_url=http://127.0.0.1:53613/s_k, leader=true}
[junit4:junit4] 2> 550090 T1248 C2608 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 550093 T1248 C2608 P53613 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 550101 T1248 C2608 P53613 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 550101 T1248 C2608 P53613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 550105 T1248 C2608 P53613 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 550105 T1248 C2608 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 550107 T1288 C2607 P53632 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 550107 T1288 C2607 P53632 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 550109 T1245 C2608 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 550110 T1288 C2607 P53632 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 550110 T1288 C2607 P53632 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 550110 T1288 C2607 P53632 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 550115 T1247 C2608 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 550115 T1288 C2607 P53632 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 550117 T1288 C2607 P53632 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index.20130618050614732
[junit4:junit4] 2> 550120 T1288 C2607 P53632 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index.20130618050614732 lockFactory=org.apache.lucene.store.NativeFSLockFactory@16697fd; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 550125 T1246 C2608 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 550127 T1288 C2607 P53632 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 550132 T1288 C2607 P53632 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 550133 T1288 C2607 P53632 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 550140 T1288 C2607 P53632 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 550140 T1288 C2607 P53632 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 550140 T1288 C2607 P53632 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 550145 T1288 C2607 P53632 oass.SolrIndexSearcher.<init> Opening Searcher@1375522 main
[junit4:junit4] 2> 550146 T1287 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1375522 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 550147 T1288 C2607 P53632 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index.20130618050614732 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index.20130618050614732;done=true>>]
[junit4:junit4] 2> 550147 T1288 C2607 P53632 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index.20130618050614732
[junit4:junit4] 2> 550147 T1288 C2607 P53632 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index.20130618050614732
[junit4:junit4] 2> 550148 T1288 C2607 P53632 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 550150 T1288 C2607 P53632 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 550151 T1288 C2607 P53632 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 550151 T1288 C2607 P53632 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> ASYNC NEW_CORE C2609 name=collection1 org.apache.solr.core.SolrCore@1cbfd8e url=http://127.0.0.1:53632/s_k/collection1 node=127.0.0.1:53632_s_k C2609_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53632_s_k, base_url=http://127.0.0.1:53632/s_k}
[junit4:junit4] 2> 550193 T1288 C2609 P53632 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 550418 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 550420 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53632_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53632/s_k"}
[junit4:junit4] 2> 550432 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 550433 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 550434 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 550434 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 550434 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 550435 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 550728 T1305 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 550739 T1305 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 550743 T1305 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 550766 T1305 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 550779 T1305 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 550785 T1305 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 550788 T1305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 550788 T1305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 550788 T1305 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 550790 T1305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 550790 T1305 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 550790 T1305 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 550791 T1305 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371546372023\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty4\
[junit4:junit4] 2> 550791 T1305 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2143e4
[junit4:junit4] 2> 550791 T1305 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 550792 T1305 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4
[junit4:junit4] 2> 550793 T1305 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371546351361/jetty4\index/
[junit4:junit4] 2> 550794 T1305 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 550795 T1305 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index
[junit4:junit4] 2> 550804 T1305 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 550804 T1305 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 550809 T1305 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 550809 T1305 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 550810 T1305 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 550810 T1305 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 550811 T1305 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 550811 T1305 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 550818 T1305 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 550819 T1305 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 550820 T1305 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 550830 T1305 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 550839 T1305 oass.SolrIndexSearcher.<init> Opening Searcher@d10c60 main
[junit4:junit4] 2> 550842 T1305 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 550842 T1305 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 550847 T1308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d10c60 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 550849 T1305 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 550849 T1305 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53645/s_k collection:collection1 shard:shard1
[junit4:junit4] 2> 550857 T1305 oasc.ZkController.register We are http://127.0.0.1:53645/s_k/collection1/ and leader is http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 550857 T1305 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53645/s_k
[junit4:junit4] 2> 550857 T1305 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 550857 T1305 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2610 name=collection1 org.apache.solr.core.SolrCore@5e3229 url=http://127.0.0.1:53645/s_k/collection1 node=127.0.0.1:53645_s_k C2610_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53645_s_k, base_url=http://127.0.0.1:53645/s_k}
[junit4:junit4] 2> 550857 T1309 C2610 P53645 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 550858 T1309 C2610 P53645 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 550858 T1309 C2610 P53645 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 550858 T1309 C2610 P53645 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 550858 T1305 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 550861 T1309 C2610 P53645 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 550864 T1210 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 550864 T1210 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 550865 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 550877 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 550878 T1248 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 550879 T1210 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 550879 T1210 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 550881 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 551775 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 551783 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 551784 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53645_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53645/s_k"}
[junit4:junit4] 2> 551793 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 551794 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 551794 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 551795 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 551795 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 551795 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 552660 T1248 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 552660 T1248 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:53645_s_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1783
[junit4:junit4] 2> 552667 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 553649 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C2610_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53645_s_k, base_url=http://127.0.0.1:53645/s_k}
[junit4:junit4] 2> 554619 T1309 C2610 P53645 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53613/s_k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 554619 T1309 C2610 P53645 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53645/s_k START replicas=[http://127.0.0.1:53613/s_k/collection1/] nUpdates=100
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53613/s_k/collection1/. core=collection1
[junit4:junit4] 2> 554620 T1309 C2610 P53645 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2611 name=collection1 org.apache.solr.core.SolrCore@12c3f84 url=http://127.0.0.1:53613/s_k/collection1 node=127.0.0.1:53613_s_k C2611_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53613_s_k, base_url=http://127.0.0.1:53613/s_k, leader=true}
[junit4:junit4] 2> 554622 T1245 C2611 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 554628 T1248 C2611 P53613 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 554631 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 554644 T1248 C2611 P53613 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 554645 T1248 C2611 P53613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 554647 T1248 C2611 P53613 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 554647 T1248 C2611 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 2> 554649 T1309 C2610 P53645 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 554649 T1309 C2610 P53645 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 554651 T1246 C2611 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 554652 T1309 C2610 P53645 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 554652 T1309 C2610 P53645 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 554652 T1309 C2610 P53645 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 554658 T1243 C2611 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=3
[junit4:junit4] 2> 554659 T1309 C2610 P53645 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 554661 T1309 C2610 P53645 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index.20130618050619275
[junit4:junit4] 2> 554663 T1309 C2610 P53645 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index.20130618050619275 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bd5c81; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 554666 T1244 C2611 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C2612 name=collection1 org.apache.solr.core.SolrCore@5e3229 url=http://127.0.0.1:53645/s_k/collection1 node=127.0.0.1:53645_s_k C2612_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53645_s_k, base_url=http://127.0.0.1:53645/s_k}
[junit4:junit4] 2> 554675 T1309 C2612 P53645 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 554681 T1309 C2612 P53645 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 554681 T1309 C2612 P53645 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 554685 T1309 C2612 P53645 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 554687 T1309 C2612 P53645 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 554687 T1309 C2612 P53645 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 554689 T1309 C2612 P53645 oass.SolrIndexSearcher.<init> Opening Searcher@196f998 main
[junit4:junit4] 2> 554690 T1308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@196f998 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 554691 T1309 C2612 P53645 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index.20130618050619275 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index.20130618050619275;done=true>>]
[junit4:junit4] 2> 554691 T1309 C2612 P53645 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index.20130618050619275
[junit4:junit4] 2> 554691 T1309 C2612 P53645 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index.20130618050619275
[junit4:junit4] 2> 554692 T1309 C2612 P53645 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 554693 T1309 C2612 P53645 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 554693 T1309 C2612 P53645 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 554693 T1309 C2612 P53645 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 554697 T1309 C2612 P53645 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 555614 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 556134 T1233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 556135 T1233 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53645_s_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53645/s_k"}
[junit4:junit4] 2> 556151 T1285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556152 T1304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556152 T1252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556153 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556152 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556153 T1268 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556597 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 556599 T1210 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C2613 name=collection1 org.apache.solr.core.SolrCore@71f114 url=http://127.0.0.1:53601/s_k/collection1 node=127.0.0.1:53601_s_k C2613_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:53601_s_k, base_url=http://127.0.0.1:53601/s_k, leader=true}
[junit4:junit4] 2> 556612 T1226 C2613 P53601 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 556620 T1226 C2613 P53601 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1688f5c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 556621 T1226 C2613 P53601 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 556629 T1226 C2613 P53601 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1688f5c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1688f5c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 556630 T1226 C2613 P53601 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 556634 T1226 C2613 P53601 oass.SolrIndexSearcher.<init> Opening Searcher@1db5c04 main
[junit4:junit4] 2> 556635 T1226 C2613 P53601 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 556635 T1236 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1db5c04 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 556637 T1226 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> ASYNC NEW_CORE C2614 name=collection1 org.apache.solr.core.SolrCore@1cbfd8e url=http://127.0.0.1:53632/s_k/collection1 node=127.0.0.1:53632_s_k C2614_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53632_s_k, base_url=http://127.0.0.1:53632/s_k}
[junit4:junit4] 2> 556666 T1281 C2614 P53632 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53613/s_k/collection1/, StdNode: http://127.0.0.1:53622/s_k/collection1/, StdNode: http://127.0.0.1:53632/s_k/collection1/, StdNode: http://127.0.0.1:53645/s_k/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C2615 name=collection1 org.apache.solr.core.SolrCore@12c3f84 url=http://127.0.0.1:53613/s_k/collection1 node=127.0.0.1:53613_s_k C2615_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53613_s_k, base_url=http://127.0.0.1:53613/s_k, leader=true}
[junit4:junit4] 2> 556673 T1246 C2615 P53613 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 556676 T1276 C2614 P53632 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C2616 name=collection1 org.apache.solr.core.SolrCore@1dffda9 url=http://127.0.0.1:53622/s_k/collection1 node=127.0.0.1:53622_s_k C2616_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53622_s_k, base_url=http://127.0.0.1:53622/s_k}
[junit4:junit4] 2> 556683 T1264 C2616 P53622 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C2612_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53645_s_k, base_url=http://127.0.0.1:53645/s_k}
[junit4:junit4] 2> 556684 T1295 C2612 P53645 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 556696 T1276 C2614 P53632 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 556697 T1295 C2612 P53645 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 556698 T1295 C2612 P53645 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 556697 T1276 C2614 P53632 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 556703 T1295 C2612 P53645 oass.SolrIndexSearcher.<init> Opening Searcher@982bad main
[junit4:junit4] 2> 556703 T1295 C2612 P53645 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 556705 T1276 C2614 P53632 oass.SolrIndexSearcher.<init> Opening Searcher@d72080 main
[junit4:junit4] 2> 556705 T1276 C2614 P53632 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 556706 T1287 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d72080 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 556706 T1276 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4] 2> 556707 T1308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@982bad main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 556709 T1295 C2612 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 556712 T1246 C2615 P53613 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 556713 T1246 C2615 P53613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 556715 T1264 C2616 P53622 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 556715 T1264 C2616 P53622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 556717 T1246 C2615 P53613 oass.SolrIndexSearcher.<init> Opening Searcher@1a93299 main
[junit4:junit4] 2> 556718 T1246 C2615 P53613 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 556719 T1254 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a93299 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 556720 T1246 C2615 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 48
[junit4:junit4] 2> 556720 T1264 C2616 P53622 oass.SolrIndexSearcher.<init> Opening Searcher@63ebd8 main
[junit4:junit4] 2> 556721 T1264 C2616 P53622 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 556721 T1270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63ebd8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 556722 T1264 C2616 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 39
[junit4:junit4] 2> 556723 T1281 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 58
[junit4:junit4] 2> 556725 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 556728 T1243 C2615 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 556732 T1259 C2616 P53622 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 556734 T1277 C2614 P53632 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 556739 T1296 C2612 P53645 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 558709 T1224 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438170620434055168)} 0 7
[junit4:junit4] 2> 558732 T1264 C2616 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={update.distrib=FROMLEADER&_version_=-1438170620448735232&update.from=http://127.0.0.1:53613/s_k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438170620448735232)} 0 2
[junit4:junit4] 2> 558733 T1276 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={update.distrib=FROMLEADER&_version_=-1438170620448735232&update.from=http://127.0.0.1:53613/s_k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438170620448735232)} 0 5
[junit4:junit4] 2> 558738 T1300 C2612 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={update.distrib=FROMLEADER&_version_=-1438170620448735232&update.from=http://127.0.0.1:53613/s_k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438170620448735232)} 0 4
[junit4:junit4] 2> 558739 T1247 C2615 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438170620448735232)} 0 23
[junit4:junit4] 2> 558741 T1263 C2616 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 30
[junit4:junit4] 2> 558746 T1225 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {add=[0 (1438170620477046784)]} 0 4
[junit4:junit4] 2> 558760 T1295 C2612 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438170620484386816)]} 0 4
[junit4:junit4] 2> 558763 T1281 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438170620484386816)]} 0 7
[junit4:junit4] 2> 558765 T1259 C2616 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438170620484386816)]} 0 7
[junit4:junit4] 2> 558766 T1246 C2615 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {add=[0 (1438170620484386816)]} 0 17
[junit4:junit4] 2> 558770 T1226 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {add=[1 (1438170620505358336)]} 0 1
[junit4:junit4] 2> 558779 T1277 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438170620510601216)]} 0 1
[junit4:junit4] 2> 558779 T1260 C2616 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438170620510601216)]} 0 1
[junit4:junit4] 2> 558781 T1296 C2612 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438170620510601216)]} 0 1
[junit4:junit4] 2> 558782 T1243 C2615 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {add=[1 (1438170620510601216)]} 0 8
[junit4:junit4] 2> 558786 T1227 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {add=[2 (1438170620522135552)]} 0 0
[junit4:junit4] 2> 558794 T1244 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53622/s_k/collection1/]
[junit4:junit4] 2> 558794 T1244 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53622/s_k/collection1/ against:[http://127.0.0.1:53622/s_k/collection1/] result:true
[junit4:junit4] 2> 558795 T1244 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53632/s_k/collection1/ against:[http://127.0.0.1:53622/s_k/collection1/] result:false
[junit4:junit4] 2> 558795 T1244 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53645/s_k/collection1/ against:[http://127.0.0.1:53622/s_k/collection1/] result:false
[junit4:junit4] 2> 558800 T1297 C2612 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[2 (1438170620531572736)]} 0 1
[junit4:junit4] 2> 558800 T1279 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[2 (1438170620531572736)]} 0 1
[junit4:junit4] 2> 558802 T1244 C2615 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53632/s_k/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[2 (1438170620531572736)]} 0 9
[junit4:junit4] 2> 558804 T1278 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[2]} 0 14
[junit4:junit4] 2> 558809 T1228 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={wt=javabin&version=2} {add=[3 (1438170620545204224)]} 0 1
[junit4:junit4] 2> 558815 T1245 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:53622/s_k/collection1/]
[junit4:junit4] 2> 558816 T1245 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53622/s_k/collection1/ against:[http://127.0.0.1:53622/s_k/collection1/] result:true
[junit4:junit4] 2> 558816 T1245 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53632/s_k/collection1/ against:[http://127.0.0.1:53622/s_k/collection1/] result:false
[junit4:junit4] 2> 558816 T1245 C2615 P53613 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:53645/s_k/collection1/ against:[http://127.0.0.1:53622/s_k/collection1/] result:false
[junit4:junit4] 2> 558821 T1298 C2612 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[3 (1438170620554641408)]} 0 1
[junit4:junit4] 2> 558821 T1280 C2614 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53613/s_k/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[3 (1438170620554641408)]} 0 1
[junit4:junit4] 2> 558823 T1245 C2615 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={distrib.from=http://127.0.0.1:53622/s_k/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&wt=javabin&version=2} {add=[3 (1438170620554641408)]} 0 9
[junit4:junit4] 2> 558824 T1261 C2616 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={test.distrib.skip.servers=http://127.0.0.1:53622/s_k/collection1/&test.distrib.skip.servers=http://127.0.0.1:53632/s_k/collection1/&wt=javabin&version=2} {add=[3]} 0 12
[junit4:junit4] 2> 558828 T1223 C2613 P53601 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 558883 T1223 C2613 P53601 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1688f5c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1688f5c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 558883 T1223 C2613 P53601 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 558890 T1223 C2613 P53601 oass.SolrIndexSearcher.<init> Opening Searcher@8049ac main
[junit4:junit4] 2> 558891 T1223 C2613 P53601 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 558892 T1236 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8049ac main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 558892 T1223 C2613 P53601 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 64
[junit4:junit4] 2> 558895 T1248 C2615 P53613 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53613/s_k/collection1/, StdNode: http://127.0.0.1:53622/s_k/collection1/, StdNode: http://127.0.0.1:53632/s_k/collection1/, StdNode: http://127.0.0.1:53645/s_k/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 558898 T1276 C2614 P53632 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 558899 T1247 C2615 P53613 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 558898 T1299 C2612 P53645 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 558900 T1262 C2616 P53622 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 558965 T1299 C2612 P53645 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad3acb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 558966 T1299 C2612 P53645 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 558972 T1299 C2612 P53645 oass.SolrIndexSearcher.<init> Opening Searcher@1fad864 main
[junit4:junit4] 2> 558973 T1299 C2612 P53645 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 558973 T1276 C2614 P53632 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4eb32f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 558974 T1276 C2614 P53632 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 558987 T1308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fad864 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> ASYNC NEW_CORE C2617 name=collection1 org.apache.solr.core.SolrCore@5e3229 url=http://127.0.0.1:53645/s_k/collection1 node=127.0.0.1:53645_s_k C2617_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53645_s_k, base_url=http://127.0.0.1:53645/s_k}
[junit4:junit4] 2> 558988 T1299 C2617 P53645 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 90
[junit4:junit4] 2> ASYNC NEW_CORE C2618 name=collection1 org.apache.solr.core.SolrCore@1cbfd8e url=http://127.0.0.1:53632/s_k/collection1 node=127.0.0.1:53632_s_k C2618_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53632_s_k, base_url=http://127.0.0.1:53632/s_k}
[junit4:junit4] 2> 558998 T1276 C2618 P53632 oass.SolrIndexSearcher.<init> Opening Searcher@998af main
[junit4:junit4] 2> 558999 T1276 C2618 P53632 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559002 T1287 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@998af main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 559003 T1276 C2618 P53632 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 105
[junit4:junit4] 2> ASYNC NEW_CORE C2619 name=collection1 org.apache.solr.core.SolrCore@12c3f84 url=http://127.0.0.1:53613/s_k/collection1 node=127.0.0.1:53613_s_k C2619_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53613_s_k, base_url=http://127.0.0.1:53613/s_k, leader=true}
[junit4:junit4] 2> 559034 T1247 C2619 P53613 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b19d65; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 559037 T1247 C2619 P53613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 559044 T1247 C2619 P53613 oass.SolrIndexSearcher.<init> Opening Searcher@1c6b6bd main
[junit4:junit4] 2> 559045 T1247 C2619 P53613 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559046 T1254 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c6b6bd main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 559047 T1247 C2619 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 149
[junit4:junit4] 2> ASYNC NEW_CORE C2620 name=collection1 org.apache.solr.core.SolrCore@1dffda9 url=http://127.0.0.1:53622/s_k/collection1 node=127.0.0.1:53622_s_k C2620_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53622_s_k, base_url=http://127.0.0.1:53622/s_k}
[junit4:junit4] 2> 559054 T1262 C2620 P53622 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371546351361\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@16674e4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 559055 T1262 C2620 P53622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 559065 T1262 C2620 P53622 oass.SolrIndexSearcher.<init> Opening Searcher@5ecc3a main
[junit4:junit4] 2> 559066 T1262 C2620 P53622 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559066 T1270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ecc3a main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):c2)}
[junit4:junit4] 2> 559068 T1262 C2620 P53622 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 168
[junit4:junit4] 2> 559068 T1248 C2619 P53613 oasup.LogUpdateProcessor.finish [collection1] webapp=/s_k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 173
[junit4:junit4] 2> 559069 T1210 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 559070 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 559072 T1210 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 559075 T1246 C2619 P53613 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 559078 T1264 C2620 P53622 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=1
[junit4:junit4] 2> 559082 T1281 C2618 P53632 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 559086 T1300 C2617 P53645 oasc.SolrCore.execute [collection1] webapp=/s_k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 559087 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 559100 T1277 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 559100 T1277 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 559116 T1243 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 559117 T1243 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53613/s_k/collection1/
[junit4:junit4] 2> 559117 T1243 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53613/s_k START replicas=[http://127.0.0.1:53622/s_k/collection1/, http://127.0.0.1:53632/s_k/collection1/, http://127.0.0.1:53645/s_k/collection1/] nUpdates=100
[junit4:junit4] 2> 559131 T1295 C2617 P53645 oasc.SolrCore.execute [collection1] webapp=/s_k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 559135 T1243 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:53613/s_k Received 5 versions from 127.0.0.1:53645/s_k/collection1/
[junit4:junit4] 2> 5591
[...truncated too long message...]
kspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\jetty12
[junit4:junit4] 2> 1692293 T4073 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\jetty12\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\jetty12\index;done=false>>]
[junit4:junit4] 2> 1692293 T4073 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\jetty12\index
[junit4:junit4] 2> 1692295 T4586 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89885727436177436-127.0.0.1:55041_-n_0000000012) am no longer a leader.
[junit4:junit4] 2> 1692298 T4313 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1692311 T4073 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 1692451 T4363 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1692451 T4363 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\zookeeper\server1\data\version-2\log.1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\zookeeper\server1\data\version-2 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\zookeeper\server1\data FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\zookeeper\server1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664\zookeeper FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371547354664 FAILED !!!!!
[junit4:junit4] 2> 1692749 T4073 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1692753 T4073 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:54902 54902
[junit4:junit4] 2> 1693666 T4313 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1695118 T4313 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.method=testDistribSearch -Dtests.seed=E5D0D5F06ED66AB1 -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=Antarctica/Mawson -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 165s | ChaosMonkeySafeLeaderTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard3 is not consistent. Got 4 from http://127.0.0.1:55008/collection1lastClient and got 2 from http://127.0.0.1:55041/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([E5D0D5F06ED66AB1:64365BE819890A8D]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1695126 T4073 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=MockRandom), text=Pulsing41(freqCutoff=12 minBlockSize=18 maxBlockSize=125), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=MockRandom), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=MockRandom), other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=PostingsFormat(name=MockRandom), a_si=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=DefaultSimilarity, locale=tr_TR, timezone=Antarctica/Mawson
[junit4:junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_21 (32-bit)/cpus=2,threads=1,free=32750512,total=190218240
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestRandomFaceting, TestSolrIndexConfig, ShardSplitTest, SolrCmdDistributorTest, TestCSVResponseWriter, DistributedQueryElevationComponentTest, MoreLikeThisHandlerTest, TestCollationField, TestQueryUtils, TestPluginEnable, TestRandomDVFaceting, SolrIndexSplitterTest, TestCollationKeyRangeQueries, DirectSolrConnectionTest, TestZkChroot, DebugComponentTest, TestDistributedGrouping, DisMaxRequestHandlerTest, TestSearchPerf, TestPropInject, DateFieldTest, TestBM25SimilarityFactory, IndexReaderFactoryTest, ZkCLITest, PluginInfoTest, TestNumberUtils, SolrRequestParserTest, TestAnalyzedSuggestions, TestFaceting, DirectUpdateHandlerOptimizeTest, SimpleFacetsTest, SimplePostToolTest, QueryParsingTest, TestManagedSchema, ZkNodePropsTest, TestCSVLoader, TestUtils, SpatialFilterTest, TestJoin, TestWriterPerf, DOMUtilTest, ChaosMonkeyShardSplitTest, ScriptEngineTest, ChaosMonkeyNothingIsSafeTest, CacheHeaderTest, TestDynamicFieldCollectionResource, SolrIndexConfigTest, PolyFieldTest, SyncSliceTest, TestQuerySenderNoQuery, AlternateDirectoryTest, TestPostingsSolrHighlighter, TestSolrDeletionPolicy2, TestSystemIdResolver, BasicDistributedZk2Test, TestRecovery, TestFastOutputStream, TestSolrQueryParserResource, TestSolr4Spatial, TestSort, LukeRequestHandlerTest, TestFieldCollectionResource, TestStressReorder, DocValuesTest, RegexBoostProcessorTest, SpellCheckCollatorTest, TestDocumentBuilder, TestFunctionQuery, TestDFRSimilarityFactory, LeaderElectionTest, QueryElevationComponentTest, PeerSyncTest, FileBasedSpellCheckerTest, OpenCloseCoreStressTest, DefaultValueUpdateProcessorTest, MinimalSchemaTest, TestSolrDeletionPolicy1, TestBinaryResponseWriter, LeaderElectionIntegrationTest, SolrInfoMBeanTest, IndexSchemaRuntimeFieldTest, FastVectorHighlighterTest, TestPHPSerializedResponseWriter, SynonymTokenizerTest, ShowFileRequestHandlerTest, HighlighterTest, MBeansHandlerTest, QueryEqualityTest, HighlighterConfigTest, TestBinaryField, TestPseudoReturnFields, TestLuceneMatchVersion, PreAnalyzedUpdateProcessorTest, FieldMutatingUpdateProcessorTest, DocumentBuilderTest, SuggesterTSTTest, TestLFUCache, TestDefaultSearchFieldResource, TestClassNameShortening, SuggesterWFSTTest, UniqFieldsUpdateProcessorFactoryTest, TestReplicationHandler, TestArbitraryIndexDir, TestSchemaVersionResource, TestQuerySenderListener, TestIndexSearcher, TestReversedWildcardFilterFactory, BasicDistributedZkTest, TestCloudManagedSchemaAddField, TestStressVersions, UpdateRequestProcessorFactoryTest, SolrTestCaseJ4Test, PrimUtilsTest, PingRequestHandlerTest, TestTrie, OverseerCollectionProcessorTest, TestIBSimilarityFactory, TestSurroundQueryParser, SolrCoreCheckLockOnStartupTest, TestPropInjectDefaults, TestSolrXmlPersistence, UnloadDistributedZkTest, SuggesterTest, SearchHandlerTest, TestSolrXml, TestFoldingMultitermQuery, ChaosMonkeySafeLeaderTest]
[junit4:junit4] Completed in 165.11s, 1 test, 1 failure <<< FAILURES!
[...truncated 518 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1253 tests, 2 failures, 18 ignored (12 assumptions)
Total time: 71 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.7.0_21) - Build #
2902 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2902/
Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:65175/f_ix/b returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:65175/f_ix/b returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([F027DB91E6E0E0BB:71C1558991BF8087]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.GeneratedMethodAccessor48.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 10070 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 2478933 T7096 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /f_ix/b
[junit4:junit4] 2> 2478937 T7096 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ShardSplitTest-1371520690966
[junit4:junit4] 2> 2478940 T7096 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 2478942 T7097 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 2479052 T7096 oasc.ZkTestServer.run start zk server on port:65156
[junit4:junit4] 2> 2479053 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2479068 T7103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cbd0c0e name:ZooKeeperConnection Watcher:127.0.0.1:65156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2479068 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2479068 T7096 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 2479080 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2479087 T7105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c61906e name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2479087 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2479087 T7096 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 2479095 T7096 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 2479102 T7096 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 2479107 T7096 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 2479115 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2479116 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2479127 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 2479128 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 2479136 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2479137 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2479144 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 2479145 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 2479154 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 2479155 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 2479163 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2479164 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2479169 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2479170 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2479176 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2479177 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2479185 T7096 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2479185 T7096 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2479194 T7098 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5500eb200001, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 2479648 T7096 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2479666 T7096 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65163
[junit4:junit4] 2> 2479666 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2479667 T7096 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2479668 T7096 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221
[junit4:junit4] 2> 2479668 T7096 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221\solr.xml
[junit4:junit4] 2> 2479669 T7096 oasc.CoreContainer.<init> New CoreContainer 1131498150
[junit4:junit4] 2> 2479669 T7096 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221\'
[junit4:junit4] 2> 2479670 T7096 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221\'
[junit4:junit4] 2> 2479792 T7096 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2479793 T7096 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2479793 T7096 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2479794 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2479794 T7096 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2479794 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2479794 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2479796 T7096 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2479796 T7096 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2479796 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2479804 T7096 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2479805 T7096 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65156/solr
[junit4:junit4] 2> 2479806 T7096 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2479808 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2479821 T7116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d0ed922 name:ZooKeeperConnection Watcher:127.0.0.1:65156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2479822 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2479826 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2479832 T7098 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5500eb200002, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 2479833 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2479837 T7118 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@541392a6 name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2479839 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2479842 T7096 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 2479848 T7096 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 2479855 T7096 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 2479858 T7096 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65163_f_ix%2Fb
[junit4:junit4] 2> 2479860 T7096 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65163_f_ix%2Fb
[junit4:junit4] 2> 2479866 T7096 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 2479880 T7096 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 2479885 T7096 oasc.Overseer.start Overseer (id=89883980003803139-127.0.0.1:65163_f_ix%2Fb-n_0000000000) starting
[junit4:junit4] 2> 2479893 T7096 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 2479903 T7096 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 2479906 T7120 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 2479920 T7096 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 2479927 T7096 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2479937 T7119 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 2479939 T7121 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2479939 T7121 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2481599 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2481600 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65163_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65163/f_ix/b"}
[junit4:junit4] 2> 2481600 T7119 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2481601 T7119 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 2481612 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2482145 T7121 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221\collection1
[junit4:junit4] 2> 2482145 T7121 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 2482147 T7121 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2482147 T7121 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 2482151 T7121 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221\collection1\'
[junit4:junit4] 2> 2482153 T7121 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2482154 T7121 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221/collection1/lib/README' to classloader
[junit4:junit4] 2> 2482252 T7121 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 2482319 T7121 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2482323 T7121 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2482330 T7121 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 2482950 T7121 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2482955 T7121 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2482957 T7121 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2482962 T7121 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2483005 T7121 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2483005 T7121 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-controljetty-1371520691221\collection1\, dataDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/control/data\
[junit4:junit4] 2> 2483006 T7121 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1003cac6
[junit4:junit4] 2> 2483006 T7121 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2483007 T7121 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/control/data\
[junit4:junit4] 2> 2483007 T7121 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/control/data\index/
[junit4:junit4] 2> 2483007 T7121 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ShardSplitTest-1371520690964\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2483008 T7121 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/control/data\index
[junit4:junit4] 2> 2483012 T7121 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d5836f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44ba237d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2483012 T7121 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2483016 T7121 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2483016 T7121 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2483017 T7121 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2483018 T7121 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2483018 T7121 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2483019 T7121 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2483019 T7121 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2483020 T7121 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2483020 T7121 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2483032 T7121 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2483038 T7121 oass.SolrIndexSearcher.<init> Opening Searcher@770850d3 main
[junit4:junit4] 2> 2483038 T7121 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964\control\data\tlog
[junit4:junit4] 2> 2483040 T7121 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2483041 T7121 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2483045 T7122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@770850d3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2483046 T7121 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2483046 T7121 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65163/f_ix/b collection:control_collection shard:shard1
[junit4:junit4] 2> 2483047 T7121 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2483071 T7121 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2483076 T7121 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2483076 T7121 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2483077 T7121 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65163/f_ix/b/collection1/
[junit4:junit4] 2> 2483077 T7121 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2483077 T7121 oasc.SyncStrategy.syncToMe http://127.0.0.1:65163/f_ix/b/collection1/ has no replicas
[junit4:junit4] 2> 2483077 T7121 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65163/f_ix/b/collection1/
[junit4:junit4] 2> 2483078 T7121 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2483242 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2483259 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2483293 T7121 oasc.ZkController.register We are http://127.0.0.1:65163/f_ix/b/collection1/ and leader is http://127.0.0.1:65163/f_ix/b/collection1/
[junit4:junit4] 2> 2483293 T7121 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65163/f_ix/b
[junit4:junit4] 2> 2483293 T7121 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 2483294 T7121 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 2483294 T7121 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2483299 T7121 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2483300 T7096 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 2483301 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2483301 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2483310 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 2483312 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2483317 T7125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bcb799d name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2483317 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2483319 T7096 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2483323 T7096 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 2483723 T7096 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2483727 T7096 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65175
[junit4:junit4] 2> 2483728 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2483728 T7096 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2483729 T7096 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350
[junit4:junit4] 2> 2483729 T7096 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350\solr.xml
[junit4:junit4] 2> 2483729 T7096 oasc.CoreContainer.<init> New CoreContainer 1330121721
[junit4:junit4] 2> 2483730 T7096 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350\'
[junit4:junit4] 2> 2483730 T7096 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350\'
[junit4:junit4] 2> 2483841 T7096 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2483841 T7096 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2483842 T7096 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2483843 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2483843 T7096 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2483844 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2483844 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2483845 T7096 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2483845 T7096 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2483846 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2483853 T7096 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2483853 T7096 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65156/solr
[junit4:junit4] 2> 2483854 T7096 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2483856 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2483875 T7136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53049d9c name:ZooKeeperConnection Watcher:127.0.0.1:65156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2483876 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2483880 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2483886 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2483890 T7138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f90a0b9 name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2483891 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2483898 T7096 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2484754 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2484755 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65163_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65163/f_ix/b"}
[junit4:junit4] 2> 2484767 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2484768 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2484768 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2484893 T7096 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65175_f_ix%2Fb
[junit4:junit4] 2> 2484895 T7096 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65175_f_ix%2Fb
[junit4:junit4] 2> 2484899 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2484899 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2484900 T7138 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2484901 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2484902 T7125 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2484903 T7118 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2484913 T7139 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2484913 T7139 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2486261 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2486263 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65175_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65175/f_ix/b"}
[junit4:junit4] 2> 2486263 T7119 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 2486263 T7119 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 2486278 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2486278 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2486278 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2486899 T7139 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350\collection1
[junit4:junit4] 2> 2486899 T7139 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 2486900 T7139 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2486900 T7139 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 2486903 T7139 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350\collection1\'
[junit4:junit4] 2> 2486905 T7139 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2486905 T7139 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350/collection1/lib/README' to classloader
[junit4:junit4] 2> 2486963 T7139 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 2487020 T7139 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2487023 T7139 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2487028 T7139 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 2487596 T7139 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2487600 T7139 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2487603 T7139 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2487609 T7139 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2487641 T7139 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2487642 T7139 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty1-1371520695350\collection1\, dataDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty1\
[junit4:junit4] 2> 2487642 T7139 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1003cac6
[junit4:junit4] 2> 2487642 T7139 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2487643 T7139 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty1\
[junit4:junit4] 2> 2487643 T7139 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty1\index/
[junit4:junit4] 2> 2487643 T7139 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2487644 T7139 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty1\index
[junit4:junit4] 2> 2487648 T7139 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c58843 lockFactory=org.apache.lucene.store.NativeFSLockFactory@200628b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2487648 T7139 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2487652 T7139 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2487652 T7139 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2487653 T7139 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2487654 T7139 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2487655 T7139 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2487655 T7139 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2487655 T7139 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2487656 T7139 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2487656 T7139 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2487666 T7139 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2487671 T7139 oass.SolrIndexSearcher.<init> Opening Searcher@3a49b084 main
[junit4:junit4] 2> 2487672 T7139 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty1\tlog
[junit4:junit4] 2> 2487674 T7139 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2487674 T7139 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2487677 T7140 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a49b084 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2487679 T7139 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2487679 T7139 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65175/f_ix/b collection:collection1 shard:shard1
[junit4:junit4] 2> 2487681 T7139 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 2487699 T7139 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2487704 T7139 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2487704 T7139 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2487704 T7139 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65175/f_ix/b/collection1/
[junit4:junit4] 2> 2487705 T7139 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2487705 T7139 oasc.SyncStrategy.syncToMe http://127.0.0.1:65175/f_ix/b/collection1/ has no replicas
[junit4:junit4] 2> 2487705 T7139 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65175/f_ix/b/collection1/
[junit4:junit4] 2> 2487705 T7139 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 2487773 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2487787 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2487788 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2487788 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2487820 T7139 oasc.ZkController.register We are http://127.0.0.1:65175/f_ix/b/collection1/ and leader is http://127.0.0.1:65175/f_ix/b/collection1/
[junit4:junit4] 2> 2487820 T7139 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65175/f_ix/b
[junit4:junit4] 2> 2487821 T7139 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 2487821 T7139 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 2487821 T7139 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2487826 T7139 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2487828 T7096 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 2487828 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2487829 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2488225 T7096 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2488234 T7096 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65184
[junit4:junit4] 2> 2488234 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2488234 T7096 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2488234 T7096 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865
[junit4:junit4] 2> 2488235 T7096 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865\solr.xml
[junit4:junit4] 2> 2488235 T7096 oasc.CoreContainer.<init> New CoreContainer 1784230204
[junit4:junit4] 2> 2488235 T7096 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865\'
[junit4:junit4] 2> 2488236 T7096 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865\'
[junit4:junit4] 2> 2488344 T7096 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2488344 T7096 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2488345 T7096 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2488345 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2488345 T7096 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2488346 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2488346 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2488346 T7096 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2488347 T7096 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2488347 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2488354 T7096 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2488355 T7096 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65156/solr
[junit4:junit4] 2> 2488355 T7096 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2488357 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2488376 T7152 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@660cda2c name:ZooKeeperConnection Watcher:127.0.0.1:65156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2488377 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2488380 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2488387 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2488390 T7154 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c169983 name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2488391 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2488397 T7096 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2489285 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2489286 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65175_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65175/f_ix/b"}
[junit4:junit4] 2> 2489300 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2489300 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2489301 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2489300 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2489391 T7096 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65184_f_ix%2Fb
[junit4:junit4] 2> 2489394 T7096 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65184_f_ix%2Fb
[junit4:junit4] 2> 2489398 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2489398 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 2489399 T7138 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2489399 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2489400 T7154 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2489400 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2489404 T7125 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2489404 T7118 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2489414 T7155 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2489414 T7155 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2490795 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2490796 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65184_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65184/f_ix/b"}
[junit4:junit4] 2> 2490797 T7119 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 2490797 T7119 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 2490811 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2490811 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2490814 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2490811 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2491396 T7155 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865\collection1
[junit4:junit4] 2> 2491396 T7155 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 2491399 T7155 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2491399 T7155 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 2491405 T7155 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865\collection1\'
[junit4:junit4] 2> 2491409 T7155 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2491411 T7155 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865/collection1/lib/README' to classloader
[junit4:junit4] 2> 2491511 T7155 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 2491576 T7155 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2491579 T7155 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2491586 T7155 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 2492186 T7155 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2492189 T7155 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2492192 T7155 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2492197 T7155 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2492233 T7155 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2492234 T7155 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty2-1371520699865\collection1\, dataDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty2\
[junit4:junit4] 2> 2492234 T7155 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1003cac6
[junit4:junit4] 2> 2492234 T7155 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2492235 T7155 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty2\
[junit4:junit4] 2> 2492235 T7155 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty2\index/
[junit4:junit4] 2> 2492236 T7155 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2492237 T7155 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty2\index
[junit4:junit4] 2> 2492240 T7155 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e748e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c4b249d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2492240 T7155 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2492244 T7155 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2492245 T7155 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2492245 T7155 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2492246 T7155 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2492247 T7155 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2492247 T7155 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2492247 T7155 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2492248 T7155 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2492248 T7155 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2492259 T7155 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2492266 T7155 oass.SolrIndexSearcher.<init> Opening Searcher@89aa50e main
[junit4:junit4] 2> 2492266 T7155 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty2\tlog
[junit4:junit4] 2> 2492268 T7155 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2492268 T7155 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2492272 T7156 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@89aa50e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2492274 T7155 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2492274 T7155 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65184/f_ix/b collection:collection1 shard:shard2
[junit4:junit4] 2> 2492275 T7155 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 2492296 T7155 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2492301 T7155 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2492301 T7155 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2492301 T7155 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65184/f_ix/b/collection1/
[junit4:junit4] 2> 2492301 T7155 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2492302 T7155 oasc.SyncStrategy.syncToMe http://127.0.0.1:65184/f_ix/b/collection1/ has no replicas
[junit4:junit4] 2> 2492302 T7155 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65184/f_ix/b/collection1/
[junit4:junit4] 2> 2492302 T7155 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 2492314 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2492331 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2492332 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2492331 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2492331 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2492364 T7155 oasc.ZkController.register We are http://127.0.0.1:65184/f_ix/b/collection1/ and leader is http://127.0.0.1:65184/f_ix/b/collection1/
[junit4:junit4] 2> 2492364 T7155 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65184/f_ix/b
[junit4:junit4] 2> 2492364 T7155 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 2492365 T7155 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 2492365 T7155 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2492371 T7155 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2492372 T7096 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 2492373 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2492374 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2492792 T7096 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2492796 T7096 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65193
[junit4:junit4] 2> 2492798 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2492798 T7096 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2492798 T7096 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408
[junit4:junit4] 2> 2492799 T7096 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408\solr.xml
[junit4:junit4] 2> 2492799 T7096 oasc.CoreContainer.<init> New CoreContainer 134170344
[junit4:junit4] 2> 2492799 T7096 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408\'
[junit4:junit4] 2> 2492800 T7096 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408\'
[junit4:junit4] 2> 2492915 T7096 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2492916 T7096 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2492917 T7096 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2492917 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2492918 T7096 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2492918 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2492918 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2492918 T7096 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2492919 T7096 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2492919 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2492926 T7096 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2492927 T7096 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65156/solr
[junit4:junit4] 2> 2492928 T7096 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2492930 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2492943 T7168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63f60646 name:ZooKeeperConnection Watcher:127.0.0.1:65156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2492944 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2492947 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2492951 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2492956 T7170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4271d6b name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2492956 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2492962 T7096 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2493741 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2493741 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65184_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65184/f_ix/b"}
[junit4:junit4] 2> 2493749 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493749 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493750 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493749 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493750 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493857 T7096 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65193_f_ix%2Fb
[junit4:junit4] 2> 2493861 T7096 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65193_f_ix%2Fb
[junit4:junit4] 2> 2493864 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493866 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493866 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2493867 T7138 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2493867 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2493868 T7154 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2493868 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2493870 T7118 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2493872 T7125 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2493872 T7170 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2493881 T7171 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2493881 T7171 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2495094 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2495096 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65193_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65193/f_ix/b"}
[junit4:junit4] 2> 2495096 T7119 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 2495096 T7119 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 2495108 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2495108 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2495109 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2495108 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2495109 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2495664 T7171 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408\collection1
[junit4:junit4] 2> 2495664 T7171 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 2495665 T7171 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2495666 T7171 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 2495668 T7171 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408\collection1\'
[junit4:junit4] 2> 2495670 T7171 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2495670 T7171 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408/collection1/lib/README' to classloader
[junit4:junit4] 2> 2495717 T7171 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 2495780 T7171 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2495783 T7171 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2495787 T7171 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 2496289 T7171 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2496293 T7171 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2496295 T7171 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2496300 T7171 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2496330 T7171 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2496330 T7171 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty3-1371520704408\collection1\, dataDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\
[junit4:junit4] 2> 2496330 T7171 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1003cac6
[junit4:junit4] 2> 2496331 T7171 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2496331 T7171 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\
[junit4:junit4] 2> 2496332 T7171 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index/
[junit4:junit4] 2> 2496332 T7171 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2496333 T7171 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index
[junit4:junit4] 2> 2496335 T7171 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788427c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@380abf3f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2496335 T7171 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2496340 T7171 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2496340 T7171 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2496341 T7171 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2496341 T7171 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2496342 T7171 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2496342 T7171 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2496342 T7171 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2496344 T7171 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2496344 T7171 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2496355 T7171 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2496361 T7171 oass.SolrIndexSearcher.<init> Opening Searcher@4f410522 main
[junit4:junit4] 2> 2496361 T7171 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty3\tlog
[junit4:junit4] 2> 2496364 T7171 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2496365 T7171 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2496370 T7172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f410522 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2496372 T7171 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2496372 T7171 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65193/f_ix/b collection:collection1 shard:shard1
[junit4:junit4] 2> 2496384 T7171 oasc.ZkController.register We are http://127.0.0.1:65193/f_ix/b/collection1/ and leader is http://127.0.0.1:65175/f_ix/b/collection1/
[junit4:junit4] 2> 2496385 T7171 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65193/f_ix/b
[junit4:junit4] 2> 2496385 T7171 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 2496386 T7171 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2096 name=collection1 org.apache.solr.core.SolrCore@42577fbe url=http://127.0.0.1:65193/f_ix/b/collection1 node=127.0.0.1:65193_f_ix%2Fb C2096_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65193_f_ix%2Fb, base_url=http://127.0.0.1:65193/f_ix/b}
[junit4:junit4] 2> 2496386 T7173 C2096 P65193 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 2496387 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 2496387 T7173 C2096 P65193 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 2496387 T7173 C2096 P65193 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2496387 T7171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2496390 T7173 C2096 P65193 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2496392 T7096 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 2496392 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2496392 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2496399 T7133 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 2496454 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2496454 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65193_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65193/f_ix/b"}
[junit4:junit4] 2> 2496466 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2496466 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2496468 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2496468 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2496468 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2496765 T7096 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2496770 T7096 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65203
[junit4:junit4] 2> 2496772 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2496772 T7096 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2496772 T7096 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424
[junit4:junit4] 2> 2496772 T7096 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424\solr.xml
[junit4:junit4] 2> 2496773 T7096 oasc.CoreContainer.<init> New CoreContainer 479418767
[junit4:junit4] 2> 2496773 T7096 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424\'
[junit4:junit4] 2> 2496774 T7096 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424\'
[junit4:junit4] 2> 2496879 T7096 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2496880 T7096 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2496880 T7096 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2496881 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2496881 T7096 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2496881 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2496882 T7096 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2496882 T7096 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2496883 T7096 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2496883 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2496890 T7096 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2496891 T7096 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65156/solr
[junit4:junit4] 2> 2496891 T7096 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2496894 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2496904 T7185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@97fdcb8 name:ZooKeeperConnection Watcher:127.0.0.1:65156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2496905 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2496911 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2496916 T7096 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2496920 T7187 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@426ced0b name:ZooKeeperConnection Watcher:127.0.0.1:65156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2496921 T7096 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2496927 T7096 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2497291 T7133 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 2497291 T7133 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:65193_f_ix%252Fb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=892
[junit4:junit4] 2> 2497823 T7096 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65203_f_ix%2Fb
[junit4:junit4] 2> 2497828 T7096 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65203_f_ix%2Fb
[junit4:junit4] 2> 2497835 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2497837 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2497838 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 2497839 T7187 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2497840 T7138 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2497840 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2497841 T7154 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2497842 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2497849 T7125 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2497849 T7118 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2497851 T7170 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2497862 T7188 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2497862 T7188 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C2096_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65193_f_ix%2Fb, base_url=http://127.0.0.1:65193/f_ix/b}
[junit4:junit4] 2> 2499073 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:65175/f_ix/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 2499074 T7173 C2096 P65193 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65193/f_ix/b START replicas=[http://127.0.0.1:65175/f_ix/b/collection1/] nUpdates=100
[junit4:junit4] 2> 2499075 T7173 C2096 P65193 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 2499077 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 2499077 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 2499077 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 2499079 T7173 C2096 P65193 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 2499079 T7173 C2096 P65193 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:65175/f_ix/b/collection1/. core=collection1
[junit4:junit4] 2> 2499080 T7173 C2096 P65193 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2097 name=collection1 org.apache.solr.core.SolrCore@4e2b516a url=http://127.0.0.1:65175/f_ix/b/collection1 node=127.0.0.1:65175_f_ix%2Fb C2097_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65175_f_ix%2Fb, base_url=http://127.0.0.1:65175/f_ix/b, leader=true}
[junit4:junit4] 2> 2499092 T7134 C2097 P65175 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 2499096 T7133 C2097 P65175 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2499100 T7133 C2097 P65175 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c58843 lockFactory=org.apache.lucene.store.NativeFSLockFactory@200628b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2499101 T7133 C2097 P65175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2499102 T7133 C2097 P65175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c58843 lockFactory=org.apache.lucene.store.NativeFSLockFactory@200628b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c58843 lockFactory=org.apache.lucene.store.NativeFSLockFactory@200628b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2499102 T7133 C2097 P65175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2499102 T7133 C2097 P65175 oass.SolrIndexSearcher.<init> Opening Searcher@262a5cf2 realtime
[junit4:junit4] 2> 2499103 T7133 C2097 P65175 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2499103 T7133 C2097 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 2499104 T7173 C2096 P65193 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2499104 T7173 C2096 P65193 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 2499107 T7130 C2097 P65175 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2499107 T7130 C2097 P65175 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 2499107 T7173 C2096 P65193 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 2499107 T7173 C2096 P65193 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 2499107 T7173 C2096 P65193 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 2499110 T7131 C2097 P65175 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 2499111 T7173 C2096 P65193 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 2499111 T7173 C2096 P65193 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index.20130617215831138
[junit4:junit4] 2> 2499111 T7173 C2096 P65193 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1246009d lockFactory=org.apache.lucene.store.NativeFSLockFactory@63c9ba4c) fullCopy=false
[junit4:junit4] 2> 2499114 T7132 C2097 P65175 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 2499115 T7173 C2096 P65193 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 2499116 T7173 C2096 P65193 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 2499116 T7173 C2096 P65193 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 2499119 T7173 C2096 P65193 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788427c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@380abf3f),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788427c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@380abf3f),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2499120 T7173 C2096 P65193 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2499120 T7173 C2096 P65193 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 2499120 T7173 C2096 P65193 oass.SolrIndexSearcher.<init> Opening Searcher@75f8a68a main
[junit4:junit4] 2> 2499120 T7172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@75f8a68a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2499122 T7173 C2096 P65193 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index.20130617215831138 [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index.20130617215831138;done=true>>]
[junit4:junit4] 2> 2499122 T7173 C2096 P65193 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index.20130617215831138
[junit4:junit4] 2> 2499122 T7173 C2096 P65193 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty3\index.20130617215831138
[junit4:junit4] 2> 2499122 T7173 C2096 P65193 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 2499123 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 2499123 T7173 C2096 P65193 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 2499123 T7173 C2096 P65193 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2499130 T7173 C2096 P65193 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 2499155 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2499157 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65203_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65203/f_ix/b"}
[junit4:junit4] 2> 2499157 T7119 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 2499157 T7119 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 2499166 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65193_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65193/f_ix/b"}
[junit4:junit4] 2> 2499176 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2499177 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2499178 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2499178 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2499178 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2499177 T7187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2499647 T7188 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424\collection1
[junit4:junit4] 2> 2499647 T7188 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 2499649 T7188 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2499649 T7188 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 2499655 T7188 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424\collection1\'
[junit4:junit4] 2> 2499659 T7188 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2499661 T7188 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424/collection1/lib/README' to classloader
[junit4:junit4] 2> 2499728 T7188 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 2499783 T7188 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2499785 T7188 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2499790 T7188 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 2500283 T7188 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2500286 T7188 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2500288 T7188 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2500292 T7188 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2500327 T7188 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2500328 T7188 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ShardSplitTest-jetty4-1371520708424\collection1\, dataDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\
[junit4:junit4] 2> 2500328 T7188 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1003cac6
[junit4:junit4] 2> 2500328 T7188 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2500329 T7188 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\
[junit4:junit4] 2> 2500329 T7188 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index/
[junit4:junit4] 2> 2500329 T7188 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2500331 T7188 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index
[junit4:junit4] 2> 2500333 T7188 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b124d0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@59dd25a5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2500333 T7188 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2500337 T7188 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2500337 T7188 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2500338 T7188 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2500339 T7188 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2500339 T7188 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2500339 T7188 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2500339 T7188 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2500340 T7188 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2500340 T7188 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2500352 T7188 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2500357 T7188 oass.SolrIndexSearcher.<init> Opening Searcher@2d5b7e05 main
[junit4:junit4] 2> 2500357 T7188 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=.\org.apache.solr.cloud.ShardSplitTest-1371520690964\jetty4\tlog
[junit4:junit4] 2> 2500359 T7188 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2500359 T7188 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2500363 T7191 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d5b7e05 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2500365 T7188 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2500365 T7188 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65203/f_ix/b collection:collection1 shard:shard2
[junit4:junit4] 2> 2500377 T7188 oasc.ZkController.register We are http://127.0.0.1:65203/f_ix/b/collection1/ and leader is http://127.0.0.1:65184/f_ix/b/collection1/
[junit4:junit4] 2> 2500377 T7188 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65203/f_ix/b
[junit4:junit4] 2> 2500377 T7188 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 2500378 T7188 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2098 name=collection1 org.apache.solr.core.SolrCore@3be48bf5 url=http://127.0.0.1:65203/f_ix/b/collection1 node=127.0.0.1:65203_f_ix%2Fb C2098_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65203_f_ix%2Fb, base_url=http://127.0.0.1:65203/f_ix/b}
[junit4:junit4] 2> 2500379 T7192 C2098 P65203 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 2500379 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 2500379 T7188 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2500380 T7192 C2098 P65203 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 2500381 T7192 C2098 P65203 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2500384 T7096 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 2500384 T7096 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2500385 T7096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2500386 T7192 C2098 P65203 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2500392 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2500393 T7096 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 2500393 T7096 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 2500394 T7149 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 2500394 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2500527 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2500528 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65203_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65203/f_ix/b"}
[junit4:junit4] 2> 2500535 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2500536 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2500536 T7187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2500536 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2500536 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2500536 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2501285 T7149 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 2501286 T7149 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:65203_f_ix%252Fb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=892
[junit4:junit4] 2> 2501288 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2502216 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C2098_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65203_f_ix%2Fb, base_url=http://127.0.0.1:65203/f_ix/b}
[junit4:junit4] 2> 2503192 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:65184/f_ix/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 2503192 T7192 C2098 P65203 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65203/f_ix/b START replicas=[http://127.0.0.1:65184/f_ix/b/collection1/] nUpdates=100
[junit4:junit4] 2> 2503193 T7192 C2098 P65203 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 2503193 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 2503193 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 2503194 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 2503194 T7192 C2098 P65203 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 2503195 T7192 C2098 P65203 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:65184/f_ix/b/collection1/. core=collection1
[junit4:junit4] 2> 2503195 T7192 C2098 P65203 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2099 name=collection1 org.apache.solr.core.SolrCore@3d13122c url=http://127.0.0.1:65184/f_ix/b/collection1 node=127.0.0.1:65184_f_ix%2Fb C2099_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65184_f_ix%2Fb, base_url=http://127.0.0.1:65184/f_ix/b, leader=true}
[junit4:junit4] 2> 2503203 T7150 C2099 P65184 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 2503205 T7149 C2099 P65184 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2503204 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2503210 T7149 C2099 P65184 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e748e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c4b249d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2503211 T7149 C2099 P65184 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2503212 T7149 C2099 P65184 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e748e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c4b249d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e748e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c4b249d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2503212 T7149 C2099 P65184 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2503213 T7149 C2099 P65184 oass.SolrIndexSearcher.<init> Opening Searcher@3e1936f4 realtime
[junit4:junit4] 2> 2503213 T7149 C2099 P65184 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2503213 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 2503214 T7192 C2098 P65203 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2503215 T7192 C2098 P65203 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 2503218 T7147 C2099 P65184 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2503218 T7147 C2099 P65184 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 2503219 T7192 C2098 P65203 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 2503219 T7192 C2098 P65203 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 2503219 T7192 C2098 P65203 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 2503222 T7148 C2099 P65184 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 2503224 T7192 C2098 P65203 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 2503224 T7192 C2098 P65203 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index.20130617215835251
[junit4:junit4] 2> 2503224 T7192 C2098 P65203 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cf8df8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d7b1994) fullCopy=false
[junit4:junit4] 2> 2503226 T7150 C2099 P65184 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 2503227 T7192 C2098 P65203 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 2503229 T7192 C2098 P65203 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 2503229 T7192 C2098 P65203 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 2503231 T7192 C2098 P65203 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b124d0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@59dd25a5),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b124d0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@59dd25a5),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2503233 T7192 C2098 P65203 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2503233 T7192 C2098 P65203 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 2503233 T7192 C2098 P65203 oass.SolrIndexSearcher.<init> Opening Searcher@1190b773 main
[junit4:junit4] 2> 2503234 T7191 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1190b773 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2503235 T7192 C2098 P65203 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index.20130617215835251 [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index.20130617215835251;done=true>>]
[junit4:junit4] 2> 2503235 T7192 C2098 P65203 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index.20130617215835251
[junit4:junit4] 2> 2503235 T7192 C2098 P65203 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.cloud.ShardSplitTest-1371520690964/jetty4\index.20130617215835251
[junit4:junit4] 2> 2503236 T7192 C2098 P65203 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 2503236 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 2503236 T7192 C2098 P65203 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 2503236 T7192 C2098 P65203 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2503245 T7192 C2098 P65203 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 2503359 T7119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2503361 T7119 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65203_f_ix%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65203/f_ix/b"}
[junit4:junit4] 2> 2503371 T7125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2503372 T7138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2503373 T7187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2503373 T7170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2503373 T7118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2503373 T7154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2504188 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2504189 T7096 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C2100 name=collection1 org.apache.solr.core.SolrCore@634ec4a1 url=http://127.0.0.1:65163/f_ix/b/collection1 node=127.0.0.1:65163_f_ix%2Fb C2100_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:65163_f_ix%2Fb, base_url=http://127.0.0.1:65163/f_ix/b, leader=true}
[junit4:junit4] 2> 2504200 T7110 C2100 P65163 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2504206 T7110 C2100 P65163 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d5836f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44ba237d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2504207 T7110 C2100 P65163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2504208 T7110 C2100 P65163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d5836f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44ba237d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d5836f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44ba237d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2504209 T7110 C2100 P65163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2504209 T7110 C2100 P65163 oass.SolrIndexSearcher.<init> Opening Searcher@196a0680 main
[junit4:junit4] 2> 2504209 T7110 C2100 P65163 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2504211 T7122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@196a0680 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2504211 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4] 2> 2504218 T7146 C2099 P65184 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:65175/f_ix/b/collection1/, StdNode: http://127.0.0.1:65193/f_ix/b/collection1/, StdNode: http://127.0.0.1:65184/f_ix/b/collection1/, StdNode: http://127.0.0.1:65203/f_ix/b/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C2101 name=collection1 org.apache.solr.core.SolrCore@4e2b516a url=http://127.0.0.1:65175/f_ix/b/collection1 node=127.0.0.1:65175_f_ix%2Fb C2101_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65175_f_ix%2Fb, base_url=http://127.0.0.1:65175/f_ix/b, leader=true}
[junit4:junit4] 2> 2504225 T7133 C2101 P65175 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2504225 T7147 C2099 P65184 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2504228 T7133 C2101 P65175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c58843 lockFactory=org.apache.lucene.store.NativeFSLockFactory@200628b),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c58843 lockFactory=org.apache.lucene.store.NativeFSLockFactory@200628b),segFN=segments_3,generation=3}
[junit4:junit4] 2> 2504229 T7133 C2101 P65175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 2504229 T7133 C2101 P65175 oass.SolrIndexSearcher.<init> Opening Searcher@3db69a62 main
[junit4:junit4] 2> 2504229 T7133 C2101 P65175 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> ASYNC NEW_CORE C2102 name=collection1 org.apache.solr.core.SolrCore@42577fbe url=http://127.0.0.1:65193/f_ix/b/collection1 node=127.0.0.1:65193_f_ix%2Fb C2102_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65193_f_ix%2Fb, base_url=http://127.0.0.1:65193/f_ix/b}
[junit4:junit4] 2> 2504236 T7164 C2102 P65193 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C2098_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65203_f_ix%2Fb, base_url=http://127.0.0.1:65203/f_ix/b}
[junit4:junit4] 2> 2504236 T7182 C2098 P65203 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2504238 T7140 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3db69a62 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2504238 T7164 C2102 P65193 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788427c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@380abf3f),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788427c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@380abf3f),segFN=segments_3,generation=3}
[junit4:junit4] 2> 2504241 T7164 C2102 P65193 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 2504238 T7147 C2099 P65184 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e748e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c4b249d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e748e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c4b249d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 2504242 T7147 C2099 P65184 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 2504243 T7147 C2099 P65184 oass.SolrIndexSearcher.<init> Opening Searcher@5cc0516c main
[junit4:junit4] 2> 2504242 T7164 C2102 P65193 oass.SolrIndexSearcher.<init> Opening Searcher@75564820 main
[junit4:junit4] 2> 2504244 T7164 C2102 P65193 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2504241 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 2504240 T7182 C2098 P65203 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b124d0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@59dd25a5),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b124d0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@59dd25a5),segFN=segments_3,generation=3}
[junit4:junit4] 2> 2504246 T7182 C2098 P65203 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 2504246 T7172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@75564820 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2504245 T7156 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cc0516c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2504248 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 2504244 T7147 C2099 P65184 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2504249 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4] 2> 2504247 T7182 C2098 P65203 oass.SolrIndexSearcher.<init> Opening Searcher@5002e9d1 main
[junit4:junit4] 2> 2504250 T7182 C2098 P65203 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2504251 T7191 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5002e9d1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2504251 T7182 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4] 2> 2504252 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 34
[junit4:junit4] 2> 2504253 T7096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2504256 T7129 C2101 P65175 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 2504260 T7166 C2102 P65193 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 2504261 T7148 C2099 P65184 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 2504264 T7183 C2098 P65203 oasc.SolrCore.execute [collection1] webapp=/f_ix/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 2506230 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438143708663906304)} 0 3
[junit4:junit4] 2> 2506241 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={update.distrib=FROMLEADER&_version_=-1438143708671246336&update.from=http://127.0.0.1:65175/f_ix/b/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438143708671246336)} 0 2
[junit4:junit4] 2> 2506246 T7181 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={update.distrib=FROMLEADER&_version_=-1438143708676489216&update.from=http://127.0.0.1:65184/f_ix/b/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438143708676489216)} 0 2
[junit4:junit4] 2> 2506247 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438143708676489216)} 0 8
[junit4:junit4] 2> 2506248 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438143708671246336)} 0 14
[junit4:junit4] 2> 2506253 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[a!0 (1438143708689072128)]} 0 2
[junit4:junit4] 2> 2506259 T7182 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1438143708694315008)]} 0 0
[junit4:junit4] 2> 2506261 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[a!0 (1438143708694315008)]} 0 5
[junit4:junit4] 2> 2506263 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[b!1 (1438143708701655040)]} 0 0
[junit4:junit4] 2> 2506269 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1438143708704800768)]} 0 0
[junit4:junit4] 2> 2506271 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[b!1 (1438143708704800768)]} 0 5
[junit4:junit4] 2> 2506274 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[c!2 (1438143708713189376)]} 0 0
[junit4:junit4] 2> 2506283 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1438143708720529408)]} 0 0
[junit4:junit4] 2> 2506285 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1438143708720529408)]} 0 4
[junit4:junit4] 2> 2506286 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[c!2]} 0 6
[junit4:junit4] 2> 2506290 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[d!3 (1438143708728918016)]} 0 1
[junit4:junit4] 2> 2506299 T7183 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1438143708736258048)]} 0 0
[junit4:junit4] 2> 2506300 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1438143708736258048)]} 0 4
[junit4:junit4] 2> 2506301 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[d!3]} 0 8
[junit4:junit4] 2> 2506304 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[e!4 (1438143708744646656)]} 0 0
[junit4:junit4] 2> 2506315 T7178 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1438143708751986688)]} 0 1
[junit4:junit4] 2> 2506316 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1438143708751986688)]} 0 5
[junit4:junit4] 2> 2506316 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[e!4]} 0 9
[junit4:junit4] 2> 2506319 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[f!5 (1438143708760375296)]} 0 0
[junit4:junit4] 2> 2506326 T7179 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1438143708765618176)]} 0 0
[junit4:junit4] 2> 2506327 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1438143708765618176)]} 0 3
[junit4:junit4] 2> 2506327 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[f!5]} 0 5
[junit4:junit4] 2> 2506330 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[g!6 (1438143708771909632)]} 0 0
[junit4:junit4] 2> 2506336 T7161 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1438143708775055360)]} 0 1
[junit4:junit4] 2> 2506337 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[g!6 (1438143708775055360)]} 0 4
[junit4:junit4] 2> 2506340 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[h!7 (1438143708782395392)]} 0 0
[junit4:junit4] 2> 2506345 T7162 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1438143708785541120)]} 0 0
[junit4:junit4] 2> 2506347 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[h!7 (1438143708785541120)]} 0 4
[junit4:junit4] 2> 2506349 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[i!8 (1438143708791832576)]} 0 0
[junit4:junit4] 2> 2506355 T7163 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1438143708794978304)]} 0 0
[junit4:junit4] 2> 2506357 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[i!8 (1438143708794978304)]} 0 5
[junit4:junit4] 2> 2506360 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[j!9 (1438143708803366912)]} 0 0
[junit4:junit4] 2> 2506367 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1438143708807561216)]} 0 0
[junit4:junit4] 2> 2506368 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[j!9 (1438143708807561216)]} 0 4
[junit4:junit4] 2> 2506371 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[k!10 (1438143708814901248)]} 0 0
[junit4:junit4] 2> 2506376 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1438143708818046976)]} 0 0
[junit4:junit4] 2> 2506378 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[k!10 (1438143708818046976)]} 0 5
[junit4:junit4] 2> 2506381 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[l!11 (1438143708825387008)]} 0 0
[junit4:junit4] 2> 2506386 T7180 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1438143708828532736)]} 0 0
[junit4:junit4] 2> 2506387 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[l!11 (1438143708828532736)]} 0 3
[junit4:junit4] 2> 2506390 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[m!12 (1438143708834824192)]} 0 0
[junit4:junit4] 2> 2506399 T7181 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1438143708841115648)]} 0 0
[junit4:junit4] 2> 2506400 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1438143708841115648)]} 0 4
[junit4:junit4] 2> 2506401 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[m!12]} 0 8
[junit4:junit4] 2> 2506403 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[n!13 (1438143708848455680)]} 0 0
[junit4:junit4] 2> 2506411 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1438143708853698560)]} 0 0
[junit4:junit4] 2> 2506412 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1438143708853698560)]} 0 4
[junit4:junit4] 2> 2506413 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[n!13]} 0 7
[junit4:junit4] 2> 2506415 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[o!14 (1438143708861038592)]} 0 0
[junit4:junit4] 2> 2506421 T7182 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1438143708863135744)]} 0 0
[junit4:junit4] 2> 2506422 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[o!14 (1438143708863135744)]} 0 5
[junit4:junit4] 2> 2506424 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[p!15 (1438143708870475776)]} 0 0
[junit4:junit4] 2> 2506432 T7161 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1438143708875718656)]} 0 0
[junit4:junit4] 2> 2506433 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1438143708875718656)]} 0 4
[junit4:junit4] 2> 2506434 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[p!15]} 0 7
[junit4:junit4] 2> 2506437 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[q!16 (1438143708884107264)]} 0 0
[junit4:junit4] 2> 2506442 T7162 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1438143708886204416)]} 0 0
[junit4:junit4] 2> 2506443 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[q!16 (1438143708886204416)]} 0 4
[junit4:junit4] 2> 2506446 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[r!17 (1438143708893544448)]} 0 0
[junit4:junit4] 2> 2506454 T7183 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1438143708898787328)]} 0 0
[junit4:junit4] 2> 2506455 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1438143708898787328)]} 0 4
[junit4:junit4] 2> 2506456 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[r!17]} 0 7
[junit4:junit4] 2> 2506459 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[s!18 (1438143708907175936)]} 0 0
[junit4:junit4] 2> 2506467 T7163 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1438143708912418816)]} 0 0
[junit4:junit4] 2> 2506469 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1438143708912418816)]} 0 5
[junit4:junit4] 2> 2506469 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[s!18]} 0 8
[junit4:junit4] 2> 2506472 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[t!19 (1438143708920807424)]} 0 0
[junit4:junit4] 2> 2506478 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1438143708923953152)]} 0 0
[junit4:junit4] 2> 2506480 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[t!19 (1438143708923953152)]} 0 5
[junit4:junit4] 2> 2506482 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[u!20 (1438143708931293184)]} 0 0
[junit4:junit4] 2> 2506490 T7178 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1438143708935487488)]} 0 1
[junit4:junit4] 2> 2506491 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[u!20 (1438143708935487488)]} 0 5
[junit4:junit4] 2> 2506495 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[v!21 (1438143708944924672)]} 0 1
[junit4:junit4] 2> 2506504 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1438143708950167552)]} 0 0
[junit4:junit4] 2> 2506504 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1438143708950167552)]} 0 4
[junit4:junit4] 2> 2506505 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[v!21]} 0 7
[junit4:junit4] 2> 2506507 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[w!22 (1438143708957507584)]} 0 0
[junit4:junit4] 2> 2506513 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1438143708961701888)]} 0 0
[junit4:junit4] 2> 2506514 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[w!22 (1438143708961701888)]} 0 3
[junit4:junit4] 2> 2506519 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[x!23 (1438143708969041920)]} 0 1
[junit4:junit4] 2> 2506526 T7179 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1438143708974284800)]} 0 1
[junit4:junit4] 2> 2506527 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[x!23 (1438143708974284800)]} 0 5
[junit4:junit4] 2> 2506529 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[y!24 (1438143708980576256)]} 0 0
[junit4:junit4] 2> 2506538 T7180 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1438143708986867712)]} 0 0
[junit4:junit4] 2> 2506539 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1438143708986867712)]} 0 4
[junit4:junit4] 2> 2506540 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[y!24]} 0 7
[junit4:junit4] 2> 2506542 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[z!25 (1438143708994207744)]} 0 0
[junit4:junit4] 2> 2506549 T7161 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1438143708999450624)]} 0 0
[junit4:junit4] 2> 2506549 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1438143708999450624)]} 0 2
[junit4:junit4] 2> 2506551 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[z!25]} 0 6
[junit4:junit4] 2> 2506553 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[a!26 (1438143709005742080)]} 0 0
[junit4:junit4] 2> 2506559 T7181 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1438143709008887808)]} 0 0
[junit4:junit4] 2> 2506560 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[a!26 (1438143709008887808)]} 0 4
[junit4:junit4] 2> 2506563 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[b!27 (1438143709016227840)]} 0 0
[junit4:junit4] 2> 2506571 T7162 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1438143709021470720)]} 0 0
[junit4:junit4] 2> 2506572 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1438143709021470720)]} 0 4
[junit4:junit4] 2> 2506573 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[b!27]} 0 7
[junit4:junit4] 2> 2506575 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[c!28 (1438143709028810752)]} 0 0
[junit4:junit4] 2> 2506582 T7163 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1438143709034053632)]} 0 0
[junit4:junit4] 2> 2506583 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1438143709034053632)]} 0 3
[junit4:junit4] 2> 2506585 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[c!28]} 0 7
[junit4:junit4] 2> 2506587 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[d!29 (1438143709041393664)]} 0 0
[junit4:junit4] 2> 2506592 T7182 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1438143709044539392)]} 0 0
[junit4:junit4] 2> 2506593 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[d!29 (1438143709044539392)]} 0 3
[junit4:junit4] 2> 2506595 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[e!30 (1438143709049782272)]} 0 0
[junit4:junit4] 2> 2506603 T7183 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1438143709055025152)]} 0 0
[junit4:junit4] 2> 2506605 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1438143709055025152)]} 0 5
[junit4:junit4] 2> 2506605 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[e!30]} 0 7
[junit4:junit4] 2> 2506608 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[f!31 (1438143709063413760)]} 0 0
[junit4:junit4] 2> 2506615 T7178 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1438143709068656640)]} 0 0
[junit4:junit4] 2> 2506616 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1438143709068656640)]} 0 3
[junit4:junit4] 2> 2506616 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[f!31]} 0 5
[junit4:junit4] 2> 2506619 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[g!32 (1438143709074948096)]} 0 0
[junit4:junit4] 2> 2506661 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1438143709084385280)]} 0 0
[junit4:junit4] 2> 2506663 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1438143709084385280)]} 0 35
[junit4:junit4] 2> 2506663 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[g!32]} 0 39
[junit4:junit4] 2> 2506666 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[h!33 (1438143709124231168)]} 0 0
[junit4:junit4] 2> 2506672 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1438143709128425472)]} 0 0
[junit4:junit4] 2> 2506673 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[h!33 (1438143709128425472)]} 0 3
[junit4:junit4] 2> 2506676 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[i!34 (1438143709134716928)]} 0 0
[junit4:junit4] 2> 2506684 T7161 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1438143709141008384)]} 0 0
[junit4:junit4] 2> 2506685 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1438143709141008384)]} 0 3
[junit4:junit4] 2> 2506685 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[i!34]} 0 5
[junit4:junit4] 2> 2506688 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[j!35 (1438143709147299840)]} 0 0
[junit4:junit4] 2> 2506697 T7162 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1438143709152542720)]} 0 0
[junit4:junit4] 2> 2506698 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1438143709152542720)]} 0 5
[junit4:junit4] 2> 2506699 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[j!35]} 0 8
[junit4:junit4] 2> 2506702 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[k!36 (1438143709161979904)]} 0 0
[junit4:junit4] 2> 2506708 T7163 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1438143709165125632)]} 0 0
[junit4:junit4] 2> 2506709 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[k!36 (1438143709165125632)]} 0 4
[junit4:junit4] 2> 2506712 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[l!37 (1438143709172465664)]} 0 0
[junit4:junit4] 2> 2506720 T7179 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1438143709177708544)]} 0 0
[junit4:junit4] 2> 2506721 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1438143709177708544)]} 0 4
[junit4:junit4] 2> 2506722 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[l!37]} 0 7
[junit4:junit4] 2> 2506725 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[m!38 (1438143709186097152)]} 0 0
[junit4:junit4] 2> 2506733 T7181 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1438143709191340032)]} 0 0
[junit4:junit4] 2> 2506734 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!38 (1438143709191340032)]} 0 4
[junit4:junit4] 2> 2506735 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[m!38]} 0 7
[junit4:junit4] 2> 2506738 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[n!39 (1438143709199728640)]} 0 0
[junit4:junit4] 2> 2506743 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1438143709202874368)]} 0 0
[junit4:junit4] 2> 2506744 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[n!39 (1438143709202874368)]} 0 3
[junit4:junit4] 2> 2506746 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[o!40 (1438143709208117248)]} 0 0
[junit4:junit4] 2> 2506751 T7182 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1438143709211262976)]} 0 0
[junit4:junit4] 2> 2506752 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[o!40 (1438143709211262976)]} 0 3
[junit4:junit4] 2> 2506755 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[p!41 (1438143709217554432)]} 0 0
[junit4:junit4] 2> 2506762 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1438143709220700160)]} 0 1
[junit4:junit4] 2> 2506763 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[p!41 (1438143709220700160)]} 0 5
[junit4:junit4] 2> 2506765 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[q!42 (1438143709228040192)]} 0 0
[junit4:junit4] 2> 2506771 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1438143709231185920)]} 0 0
[junit4:junit4] 2> 2506772 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[q!42 (1438143709231185920)]} 0 4
[junit4:junit4] 2> 2506775 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[r!43 (1438143709238525952)]} 0 0
[junit4:junit4] 2> 2506783 T7183 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1438143709243768832)]} 0 0
[junit4:junit4] 2> 2506784 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1438143709243768832)]} 0 4
[junit4:junit4] 2> 2506785 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[r!43]} 0 7
[junit4:junit4] 2> 2506788 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[s!44 (1438143709252157440)]} 0 0
[junit4:junit4] 2> 2506795 T7161 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1438143709258448896)]} 0 0
[junit4:junit4] 2> 2506796 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1438143709258448896)]} 0 2
[junit4:junit4] 2> 2506797 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[s!44]} 0 5
[junit4:junit4] 2> 2506800 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[t!45 (1438143709264740352)]} 0 0
[junit4:junit4] 2> 2506807 T7162 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1438143709268934656)]} 0 0
[junit4:junit4] 2> 2506808 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[t!45 (1438143709268934656)]} 0 4
[junit4:junit4] 2> 2506811 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[u!46 (1438143709276274688)]} 0 0
[junit4:junit4] 2> 2506817 T7178 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1438143709280468992)]} 0 0
[junit4:junit4] 2> 2506818 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[u!46 (1438143709280468992)]} 0 3
[junit4:junit4] 2> 2506821 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[v!47 (1438143709286760448)]} 0 0
[junit4:junit4] 2> 2506828 T7163 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1438143709290954752)]} 0 0
[junit4:junit4] 2> 2506830 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[v!47 (1438143709290954752)]} 0 6
[junit4:junit4] 2> 2506833 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[w!48 (1438143709299343360)]} 0 0
[junit4:junit4] 2> 2506839 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1438143709302489088)]} 0 0
[junit4:junit4] 2> 2506840 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[w!48 (1438143709302489088)]} 0 4
[junit4:junit4] 2> 2506843 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[x!49 (1438143709309829120)]} 0 0
[junit4:junit4] 2> 2506850 T7180 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1438143709312974848)]} 0 1
[junit4:junit4] 2> 2506853 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[x!49 (1438143709312974848)]} 0 7
[junit4:junit4] 2> 2506856 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[y!50 (1438143709323460608)]} 0 0
[junit4:junit4] 2> 2506865 T7179 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1438143709328703488)]} 0 0
[junit4:junit4] 2> 2506867 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1438143709328703488)]} 0 6
[junit4:junit4] 2> 2506867 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[y!50]} 0 8
[junit4:junit4] 2> 2506870 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[z!51 (1438143709338140672)]} 0 0
[junit4:junit4] 2> 2506876 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1438143709341286400)]} 0 0
[junit4:junit4] 2> 2506878 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[z!51 (1438143709341286400)]} 0 5
[junit4:junit4] 2> 2506881 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[a!52 (1438143709349675008)]} 0 0
[junit4:junit4] 2> 2506889 T7181 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1438143709353869312)]} 0 0
[junit4:junit4] 2> 2506890 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1438143709353869312)]} 0 5
[junit4:junit4] 2> 2506891 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[a!52]} 0 7
[junit4:junit4] 2> 2506902 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[b!53 (1438143709366452224)]} 0 6
[junit4:junit4] 2> 2506911 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1438143709375889408)]} 0 1
[junit4:junit4] 2> 2506912 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[b!53 (1438143709375889408)]} 0 6
[junit4:junit4] 2> 2506917 T7110 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[c!54 (1438143709387423744)]} 0 1
[junit4:junit4] 2> 2506928 T7161 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1438143709394763776)]} 0 1
[junit4:junit4] 2> 2506928 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1438143709394763776)]} 0 5
[junit4:junit4] 2> 2506929 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[c!54]} 0 9
[junit4:junit4] 2> 2506934 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[d!55 (1438143709405249536)]} 0 1
[junit4:junit4] 2> 2506943 T7182 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1438143709409443840)]} 0 1
[junit4:junit4] 2> 2506946 T7148 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[d!55 (1438143709409443840)]} 0 8
[junit4:junit4] 2> 2506949 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[e!56 (1438143709420978176)]} 0 0
[junit4:junit4] 2> 2506957 T7183 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1438143709425172480)]} 0 1
[junit4:junit4] 2> 2506958 T7150 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1438143709425172480)]} 0 5
[junit4:junit4] 2> 2506959 T7132 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[e!56]} 0 8
[junit4:junit4] 2> 2506962 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[f!57 (1438143709434609664)]} 0 0
[junit4:junit4] 2> 2506970 T7178 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1438143709438803968)]} 0 1
[junit4:junit4] 2> 2506971 T7144 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[f!57 (1438143709438803968)]} 0 5
[junit4:junit4] 2> 2506973 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[g!58 (1438143709446144000)]} 0 0
[junit4:junit4] 2> 2506978 T7162 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1438143709448241152)]} 0 0
[junit4:junit4] 2> 2506979 T7134 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[g!58 (1438143709448241152)]} 0 4
[junit4:junit4] 2> 2506983 T7113 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[h!59 (1438143709455581184)]} 0 1
[junit4:junit4] 2> 2506989 T7163 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1438143709459775488)]} 0 0
[junit4:junit4] 2> 2506991 T7133 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[h!59 (1438143709459775488)]} 0 5
[junit4:junit4] 2> 2506995 T7109 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[i!60 (1438143709469212672)]} 0 0
[junit4:junit4] 2> 2507002 T7165 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1438143709473406976)]} 0 0
[junit4:junit4] 2> 2507004 T7130 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1438143709473406976)]} 0 5
[junit4:junit4] 2> 2507005 T7149 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[i!60]} 0 8
[junit4:junit4] 2> 2507007 T7111 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[j!61 (1438143709481795584)]} 0 0
[junit4:junit4] 2> 2507012 T7164 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1438143709484941312)]} 0 0
[junit4:junit4] 2> 2507013 T7129 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[j!61 (1438143709484941312)]} 0 3
[junit4:junit4] 2> 2507016 T7112 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[k!62 (1438143709491232768)]} 0 0
[junit4:junit4] 2> 2507023 T7166 C2102 P65193 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65175/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1438143709495427072)]} 0 0
[junit4:junit4] 2> 2507024 T7131 C2101 P65175 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1438143709495427072)]} 0 4
[junit4:junit4] 2> 2507024 T7147 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[k!62]} 0 6
[junit4:junit4] 2> 2507027 T7114 C2100 P65163 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[l!63 (1438143709502767104)]} 0 0
[junit4:junit4] 2> 2507035 T7180 C2098 P65203 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={distrib.from=http://127.0.0.1:65184/f_ix/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1438143709506961408)]} 0 1
[junit4:junit4] 2> 2507037 T7146 C2099 P65184 oasup.LogUpdateProcessor.finish [collection1] webapp=/f_ix/b path=/update params={wt=javabin&version=2} {add=[l!
[...truncated too long message...]
ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2540638 T7187 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2541801 T7187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2541801 T7096 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 65163
[junit4:junit4] 2> 2541801 T7187 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2541820 T7096 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 2541820 T7096 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:65156 65156
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=F027DB91E6E0E0BB -Dtests.slow=true -Dtests.locale=sr__#Latn -Dtests.timezone=America/Guyana -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 62.9s | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:65175/f_ix/b returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F027DB91E6E0E0BB:71C1558991BF8087]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 2541840 T7096 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=Lucene41WithOrds), _version_=PostingsFormat(name=Memory doPackFST= true), n_ti=PostingsFormat(name=MockSep)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sr__#Latn, timezone=America/Guyana
[junit4:junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=2,threads=3,free=173236400,total=448659456
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestLMDirichletSimilarityFactory, MinimalSchemaTest, TestConfig, TestWriterPerf, TestLMJelinekMercerSimilarityFactory, ZkSolrClientTest, ChaosMonkeyNothingIsSafeTest, TestAtomicUpdateErrorCases, JSONWriterTest, SolrCoreCheckLockOnStartupTest, DocumentBuilderTest, TestOmitPositions, TestLRUCache, TestReplicationHandler, SyncSliceTest, SOLR749Test, ReturnFieldsTest, PathHierarchyTokenizerFactoryTest, TestFieldCollectionResource, TestSort, DebugComponentTest, DisMaxRequestHandlerTest, SpellCheckComponentTest, BasicFunctionalityTest, TestFuzzyAnalyzedSuggestions, TestDocumentBuilder, TestSolrDeletionPolicy1, TestCollationKeyRangeQueries, ShardRoutingTest, StandardRequestHandlerTest, DistanceFunctionTest, TestPartialUpdateDeduplication, CachingDirectoryFactoryTest, PreAnalyzedUpdateProcessorTest, TestFoldingMultitermQuery, TestFieldTypeResource, OverseerTest, WordBreakSolrSpellCheckerTest, TestAddFieldRealTimeGet, ShardRoutingCustomTest, MoreLikeThisHandlerTest, TestManagedSchema, OverseerCollectionProcessorTest, TestSolrXml, TestDFRSimilarityFactory, TestStressLucene, TestSchemaSimilarityResource, BadIndexSchemaTest, TestUniqueKeyFieldResource, SortByFunctionTest, TestFastLRUCache, TestArbitraryIndexDir, AnalysisAfterCoreReloadTest, TestPHPSerializedResponseWriter, TestSurroundQueryParser, TestStressReorder, BinaryUpdateRequestHandlerTest, TestRandomFaceting, TestExtendedDismaxParser, TestSolr4Spatial, FieldMutatingUpdateProcessorTest, TestStressVersions, BadComponentTest, TestSuggestSpellingConverter, TestPseudoReturnFields, UpdateRequestProcessorFactoryTest, TestFastWriter, TestSweetSpotSimilarityFactory, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, TestDocSet, DistributedQueryElevationComponentTest, DocValuesMultiTest, AutoCommitTest, TestReload, RAMDirectoryFactoryTest, TestSolrJ, TimeZoneUtilsTest, TestMultiCoreConfBootstrap, ResponseLogComponentTest, TestPropInjectDefaults, TestComponentsName, StatelessScriptUpdateProcessorFactoryTest, TermVectorComponentDistributedTest, XsltUpdateRequestHandlerTest, ZkControllerTest, TestStressRecovery, TestLazyCores, IndexReaderFactoryTest, SuggesterTest, SpellingQueryConverterTest, SolrPluginUtilsTest, DistributedSpellCheckComponentTest, CSVRequestHandlerTest, TestGroupingSearch, TestUtils, TestCloudManagedSchema, TestBadConfig, BadCopyFieldTest, TermVectorComponentTest, CurrencyFieldXmlFileTest, JsonLoaderTest, StatsComponentTest, MBeansHandlerTest, TestSystemIdResolver, TestSolrCoreProperties, DistributedTermsComponentTest, BasicDistributedZk2Test, TestLFUCache, PingRequestHandlerTest, TestClassNameShortening, TestFiltering, TestAnalyzedSuggestions, TestQueryUtils, SuggesterTSTTest, CurrencyFieldOpenExchangeTest, ShowFileRequestHandlerTest, XmlUpdateRequestHandlerTest, TestHashPartitioner, TestCSVResponseWriter, TestPostingsSolrHighlighter, CircularListTest, FileUtilsTest, CoreContainerCoreInitFailuresTest, ZkNodePropsTest, SuggesterFSTTest, TestPluginEnable, ChaosMonkeyShardSplitTest, SliceStateTest, TestCoreDiscovery, SuggesterWFSTTest, TestDistributedSearch, CollectionsAPIDistributedZkTest, CoreAdminHandlerTest, TestFaceting, TestIndexSearcher, TestCodecSupport, TestReloadAndDeleteDocs, TestZkChroot, TestRTGBase, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, LeaderElectionTest, TestRandomDVFaceting, ZkCLITest, SliceStateUpdateTest, TestDistributedGrouping, TestRecovery, TestRealTimeGet, TestJoin, HardAutoCommitTest, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, ConvertedLegacyTest, TestFunctionQuery, DirectUpdateHandlerTest, HighlighterTest, SoftAutoCommitTest, SolrIndexSplitterTest, SimplePostToolTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SolrRequestParserTest, DocValuesTest, TestTrie, SpatialFilterTest, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestUpdate, TestWordDelimiterFilterFactory, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, SolrInfoMBeanTest, CacheHeaderTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TermsComponentTest, RequestHandlersTest, TestValueSourceCache, TestIndexingPerformance, RequiredFieldsTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, TestJmxIntegration, TestCollationField, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, SearchHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, TestPropInject, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, SolrIndexConfigTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, OutputWriterTest, ExternalFileFieldSortTest, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestPerFieldSimilarity, TestNumberUtils, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestDefaultSimilarityFactory, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, ResourceLoaderTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, DateMathParserTest, TestSolrXMLSerializer, PreAnalyzedFieldTest, PrimUtilsTest, DateFieldTest, DOMUtilTest, ClusterStateTest, SystemInfoHandlerTest, UUIDFieldTest, SolrTestCaseJ4Test, AliasIntegrationTest, ShardSplitTest]
[junit4:junit4] Completed in 62.93s, 1 test, 1 error <<< FAILURES!
[...truncated 63 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1252 tests, 1 error, 18 ignored (12 assumptions)
Total time: 67 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.6.0_45) - Build #
2901 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2901/
Java: 64bit/jdk1.6.0_45 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Mon Jun 17 20:27:05 EEST 2013
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Mon Jun 17 20:27:05 EEST 2013
at __randomizedtesting.SeedInfo.seed([7DB9504A9D4F6B31:A612508C98670282]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1473)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:777)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:662)
Build Log:
[...truncated 8993 lines...]
[junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4:junit4] 2> 982367 T2693 oas.SolrTestCaseJ4.setUp ###Starting testEmptyCommits
[junit4:junit4] 2> 982403 T2693 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 982420 T2693 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54137
[junit4:junit4] 2> 982421 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 982422 T2693 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 982424 T2693 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master
[junit4:junit4] 2> 982425 T2693 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\solr.xml
[junit4:junit4] 2> 982425 T2693 oasc.CoreContainer.<init> New CoreContainer 1649211546
[junit4:junit4] 2> 982428 T2693 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 982429 T2693 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\'
[junit4:junit4] 2> 982431 T2693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\'
[junit4:junit4] 2> 982623 T2693 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 982624 T2693 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 982624 T2693 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 982625 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 982625 T2693 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 982627 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 982627 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 982627 T2693 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 982628 T2693 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 982628 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 982640 T2693 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 982650 T2703 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1
[junit4:junit4] 2> 982650 T2703 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\'
[junit4:junit4] 2> 982743 T2703 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 982838 T2703 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 982839 T2703 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 982845 T2703 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 982882 T2703 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 982886 T2703 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 982886 T2703 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\, dataDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\
[junit4:junit4] 2> 982887 T2703 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 982887 T2703 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 982887 T2703 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\
[junit4:junit4] 2> 982889 T2703 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\index/
[junit4:junit4] 2> 982889 T2703 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 982889 T2703 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\index
[junit4:junit4] 2> 982892 T2703 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_1,generation=1}
[junit4:junit4] 2> 982892 T2703 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 982893 T2703 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 982894 T2703 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 982894 T2703 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 982894 T2703 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 982894 T2703 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 982897 T2703 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 982910 T2703 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 982918 T2703 oass.SolrIndexSearcher.<init> Opening Searcher@3773908b main
[junit4:junit4] 2> 982919 T2703 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 982921 T2703 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 982921 T2703 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4:junit4] 2> 982921 T2703 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 982921 T2703 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 982922 T2704 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3773908b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 982925 T2693 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 982930 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 982932 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 982954 T2693 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 982959 T2693 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54140
[junit4:junit4] 2> 982961 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 982961 T2693 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 982962 T2693 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave
[junit4:junit4] 2> 982962 T2693 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\solr.xml
[junit4:junit4] 2> 982963 T2693 oasc.CoreContainer.<init> New CoreContainer 264611552
[junit4:junit4] 2> 982965 T2693 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 982966 T2693 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\'
[junit4:junit4] 2> 982968 T2693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\'
[junit4:junit4] 2> 983140 T2693 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 983140 T2693 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 983141 T2693 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 983141 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 983141 T2693 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 983143 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 983143 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 983144 T2693 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 983144 T2693 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 983146 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 983150 T2693 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 983155 T2715 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1
[junit4:junit4] 2> 983158 T2715 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\'
[junit4:junit4] 2> 983270 T2715 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 983379 T2715 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 983380 T2715 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 983386 T2715 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 983422 T2715 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 983424 T2715 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 983426 T2715 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\, dataDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\
[junit4:junit4] 2> 983426 T2715 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 983426 T2715 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 983427 T2715 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\
[junit4:junit4] 2> 983427 T2715 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index/
[junit4:junit4] 2> 983427 T2715 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 983430 T2715 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index
[junit4:junit4] 2> 983431 T2715 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 983433 T2715 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 983434 T2715 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 983435 T2715 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 983435 T2715 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 983435 T2715 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 983435 T2715 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 983437 T2715 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 983440 T2715 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 983446 T2715 oass.SolrIndexSearcher.<init> Opening Searcher@708a2c99 main
[junit4:junit4] 2> 983451 T2715 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 983451 T2715 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 983457 T2715 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4:junit4] 2> 983459 T2715 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 983459 T2716 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@708a2c99 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 983462 T2693 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 983462 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 983463 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C4464 name=collection1 org.apache.solr.core.SolrCore@7b01e273
[junit4:junit4] 2> 983488 T2699 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 983496 T2700 C4464 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_1,generation=1}
[junit4:junit4] 2> 983499 T2700 C4464 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 983499 T2700 C4464 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 4
[junit4:junit4] 2> 983506 T2701 C4464 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 983507 T2701 C4464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_2,generation=2}
[junit4:junit4] 2> 983509 T2701 C4464 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 983510 T2701 C4464 oass.SolrIndexSearcher.<init> Opening Searcher@59b175ca main
[junit4:junit4] 2> 983510 T2701 C4464 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 983511 T2704 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59b175ca main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):c1)}
[junit4:junit4] 2> 983513 T2701 C4464 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 9
[junit4:junit4] 2> 983529 T2719 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 983531 T2719 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 983533 T2702 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 983535 T2719 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 983535 T2719 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 983535 T2719 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 983547 T2697 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=9
[junit4:junit4] 2> 983550 T2719 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
[junit4:junit4] 2> 983550 T2719 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202652990
[junit4:junit4] 2> 983551 T2719 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@b0fa475 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5abf9dd1) fullCopy=false
[junit4:junit4] 2> 983554 T2698 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 983560 T2699 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 983566 T2700 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 983572 T2701 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 983573 T2719 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 983578 T2719 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 983579 T2719 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 983580 T2719 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 983580 T2719 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 983582 T2719 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 983583 T2719 oass.SolrIndexSearcher.<init> Opening Searcher@1a672565 main
[junit4:junit4] 2> 983584 T2716 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a672565 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):c1)}
[junit4:junit4] 2> 983584 T2719 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202652990 [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202652990;done=true>>]
[junit4:junit4] 2> 983586 T2719 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202652990
[junit4:junit4] 2> 983586 T2719 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202652990
[junit4:junit4] 2> ASYNC NEW_CORE C4465 name=collection1 org.apache.solr.core.SolrCore@1c76784d
[junit4:junit4] 2> 983586 T2709 C4465 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:54137/solr/replication&command=fetchindex&wait=true} status=0 QTime=60
[junit4:junit4] 2> 983594 T2712 C4465 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty1&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 983602 T2702 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=1
[junit4:junit4] 2> 983607 T2697 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 983608 T2698 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=1
[junit4:junit4] 2> 983608 T2717 oash.SnapPuller.fetchLatestIndex Slave in sync with master.
[junit4:junit4] 2> 983618 T2699 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983620 T2711 C4465 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=8
[junit4:junit4] 2> 983631 T2700 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983638 T2714 C4465 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983642 T2701 C4464 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 983644 T2701 C4464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_3,generation=3}
[junit4:junit4] 2> 983644 T2701 C4464 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 983644 T2701 C4464 oass.SolrIndexSearcher.<init> Opening Searcher@679217b7 main
[junit4:junit4] 2> 983645 T2701 C4464 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 983647 T2704 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@679217b7 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):c1)}
[junit4:junit4] 2> 983647 T2701 C4464 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 5
[junit4:junit4] 2> 983652 T2721 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 983652 T2721 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 983655 T2702 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 983658 T2721 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 983658 T2721 oash.SnapPuller.fetchLatestIndex Slave's generation: 2
[junit4:junit4] 2> 983658 T2721 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 983660 T2697 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 983662 T2721 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
[junit4:junit4] 2> 983663 T2721 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653103
[junit4:junit4] 2> 983664 T2721 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6458b2f0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ccb71f5) fullCopy=false
[junit4:junit4] 2> 983664 T2721 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfs because it already exists
[junit4:junit4] 2> 983664 T2721 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfe because it already exists
[junit4:junit4] 2> 983666 T2721 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4:junit4] 2> 983670 T2698 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 983673 T2721 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 983676 T2721 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 983676 T2721 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 983677 T2721 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4] 2> 983677 T2721 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 983678 T2721 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 983680 T2721 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 983680 T2721 oass.SolrIndexSearcher.<init> Opening Searcher@132cc337 main
[junit4:junit4] 2> 983681 T2716 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@132cc337 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c1)}
[junit4:junit4] 2> 983681 T2721 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653103 [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653103;done=true>>]
[junit4:junit4] 2> 983681 T2721 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653103
[junit4:junit4] 2> 983681 T2721 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653103
[junit4:junit4] 2> 983681 T2713 C4465 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:54137/solr/replication&command=fetchindex&wait=true} status=0 QTime=30
[junit4:junit4] 2> 983688 T2699 C4464 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 4
[junit4:junit4] 2> 983692 T2700 C4464 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 983698 T2700 C4464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_4,generation=4}
[junit4:junit4] 2> 983699 T2700 C4464 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 983702 T2700 C4464 oass.SolrIndexSearcher.<init> Opening Searcher@6a552ce5 main
[junit4:junit4] 2> 983703 T2700 C4464 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 983703 T2704 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a552ce5 main{StandardDirectoryReader(segments_4:5:nrt _0(4.4):c1 _1(4.4):c1)}
[junit4:junit4] 2> 983705 T2700 C4464 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 13
[junit4:junit4] 2> 983710 T2723 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 983710 T2723 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 983713 T2701 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 983716 T2723 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 983716 T2723 oash.SnapPuller.fetchLatestIndex Slave's generation: 3
[junit4:junit4] 2> 983716 T2723 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 983722 T2702 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=4
[junit4:junit4] 2> 983724 T2723 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 7
[junit4:junit4] 2> 983725 T2723 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653164
[junit4:junit4] 2> 983725 T2723 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b6c6877 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4b230a0f) fullCopy=false
[junit4:junit4] 2> 983725 T2723 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfs because it already exists
[junit4:junit4] 2> 983725 T2723 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfe because it already exists
[junit4:junit4] 2> 983731 T2697 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 983732 T2723 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4:junit4] 2> 983736 T2698 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 983743 T2699 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1
[junit4:junit4] 2> 983749 T2700 C4464 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 983751 T2723 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 983772 T2723 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 983772 T2723 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 983772 T2723 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4] 2> 983775 T2723 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_4,generation=4}
[junit4:junit4] 2> 983776 T2723 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 983776 T2723 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 983779 T2723 oass.SolrIndexSearcher.<init> Opening Searcher@71127eac main
[junit4:junit4] 2> 983780 T2716 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71127eac main{StandardDirectoryReader(segments_4:5:nrt _0(4.4):c1 _1(4.4):c1)}
[junit4:junit4] 2> 983780 T2723 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653164 [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653164;done=true>>]
[junit4:junit4] 2> 983780 T2723 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653164
[junit4:junit4] 2> 983780 T2723 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653164
[junit4:junit4] 2> ASYNC NEW_CORE C4466 name=collection1 org.apache.solr.core.SolrCore@1c76784d
[junit4:junit4] 2> 983782 T2710 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:54137/solr/replication&command=fetchindex&wait=true} status=0 QTime=73
[junit4:junit4] 2> 983787 T2709 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty2&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C4467 name=collection1 org.apache.solr.core.SolrCore@7b01e273
[junit4:junit4] 2> 983793 T2701 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983798 T2702 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983807 T2697 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983809 T2712 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=5
[junit4:junit4] 2> 983815 T2698 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983820 T2711 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 983826 T2699 C4467 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4:junit4] 2> 983830 T2700 C4467 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 983834 T2700 C4467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_5,generation=5}
[junit4:junit4] 2> 983834 T2700 C4467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 983836 T2700 C4467 oass.SolrIndexSearcher.<init> Opening Searcher@400ed4a2 realtime
[junit4:junit4] 2> 983836 T2700 C4467 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 983836 T2700 C4467 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={openSearcher=false&commit=true&wt=javabin&version=2} {commit=} 0 6
[junit4:junit4] 2> 983840 T2726 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 983841 T2726 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 983844 T2701 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 983845 T2726 oash.SnapPuller.fetchLatestIndex Master's generation: 5
[junit4:junit4] 2> 983845 T2726 oash.SnapPuller.fetchLatestIndex Slave's generation: 4
[junit4:junit4] 2> 983845 T2726 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 983851 T2702 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=5&version=2} status=0 QTime=2
[junit4:junit4] 2> 983852 T2726 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4:junit4] 2> 983852 T2726 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653292
[junit4:junit4] 2> 983852 T2726 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5c51cdfc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ca2beb8) fullCopy=false
[junit4:junit4] 2> 983856 T2697 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4:junit4] 2> 983931 T2726 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfs because it already exists
[junit4:junit4] 2> 983931 T2726 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfe because it already exists
[junit4:junit4] 2> 983931 T2726 oash.SnapPuller.downloadIndexFiles Skipping download for _1.si because it already exists
[junit4:junit4] 2> 983936 T2699 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_5&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=1
[junit4:junit4] 2> 983939 T2726 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4:junit4] 2> 983939 T2726 oash.SnapPuller.downloadIndexFiles Skipping download for _1.cfs because it already exists
[junit4:junit4] 2> 983945 T2700 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=2
[junit4:junit4] 2> 983949 T2701 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4:junit4] 2> 983952 T2726 oash.SnapPuller.downloadIndexFiles Skipping download for _1.cfe because it already exists
[junit4:junit4] 2> 983952 T2726 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 983957 T2726 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 983957 T2726 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 983957 T2726 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4] 2> 983963 T2726 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_5,generation=5}
[junit4:junit4] 2> 983967 T2726 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 983967 T2726 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 983969 T2726 oass.SolrIndexSearcher.<init> Opening Searcher@63cde8e main
[junit4:junit4] 2> 983971 T2716 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63cde8e main{StandardDirectoryReader(segments_5:7:nrt _0(4.4):c1 _1(4.4):c1 _2(4.4):c1)}
[junit4:junit4] 2> 983971 T2726 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653292 [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653292;done=true>>]
[junit4:junit4] 2> 983971 T2726 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653292
[junit4:junit4] 2> 983972 T2726 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653292
[junit4:junit4] 2> 983972 T2714 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:54137/solr/replication&command=fetchindex&wait=true} status=0 QTime=132
[junit4:junit4] 2> 983982 T2702 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty3&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 983987 T2710 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty3&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 983992 T2697 C4467 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4:junit4] 2> 984000 T2698 C4467 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 984004 T2698 C4467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6448b7f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a9555bb),segFN=segments_6,generation=6}
[junit4:junit4] 2> 984005 T2698 C4467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 984007 T2698 C4467 oass.SolrIndexSearcher.<init> Opening Searcher@375582b9 main
[junit4:junit4] 2> 984010 T2698 C4467 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 984011 T2704 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@375582b9 main{StandardDirectoryReader(segments_6:9:nrt _0(4.4):c1 _1(4.4):c1 _2(4.4):c1 _3(4.4):c1)}
[junit4:junit4] 2> 984011 T2698 C4467 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 13
[junit4:junit4] 2> 984016 T2728 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 984016 T2728 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 984027 T2699 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 984029 T2728 oash.SnapPuller.fetchLatestIndex Master's generation: 6
[junit4:junit4] 2> 984029 T2728 oash.SnapPuller.fetchLatestIndex Slave's generation: 5
[junit4:junit4] 2> 984029 T2728 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 984033 T2700 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=6&version=2} status=0 QTime=1
[junit4:junit4] 2> 984033 T2728 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 13
[junit4:junit4] 2> 984034 T2728 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653474
[junit4:junit4] 2> 984038 T2728 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@c28c75 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@237dabb0) fullCopy=false
[junit4:junit4] 2> 984038 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _2.si because it already exists
[junit4:junit4] 2> 984045 T2701 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=6} status=0 QTime=1
[junit4:junit4] 2> 984050 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfe because it already exists
[junit4:junit4] 2> 984050 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _2.cfs because it already exists
[junit4:junit4] 2> 984050 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _1.cfe because it already exists
[junit4:junit4] 2> 984050 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfs because it already exists
[junit4:junit4] 2> 984050 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _1.si because it already exists
[junit4:junit4] 2> 984056 T2702 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=6} status=0 QTime=1
[junit4:junit4] 2> 984070 T2697 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=6} status=0 QTime=0
[junit4:junit4] 2> 984072 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _1.cfs because it already exists
[junit4:junit4] 2> 984072 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4:junit4] 2> 984074 T2698 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_6&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=6} status=0 QTime=0
[junit4:junit4] 2> 984076 T2728 oash.SnapPuller.downloadIndexFiles Skipping download for _2.cfe because it already exists
[junit4:junit4] 2> 984077 T2728 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 984080 T2728 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 984080 T2728 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 984080 T2728 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4] 2> 984084 T2728 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=4
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@127fbc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1abe843c),segFN=segments_6,generation=6}
[junit4:junit4] 2> 984085 T2728 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 984085 T2728 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 984088 T2728 oass.SolrIndexSearcher.<init> Opening Searcher@56b3c9ce main
[junit4:junit4] 2> 984088 T2716 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56b3c9ce main{StandardDirectoryReader(segments_6:9:nrt _0(4.4):c1 _1(4.4):c1 _2(4.4):c1 _3(4.4):c1)}
[junit4:junit4] 2> 984090 T2728 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653474 [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653474;done=true>>]
[junit4:junit4] 2> 984090 T2728 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653474
[junit4:junit4] 2> 984090 T2728 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index.20130617202653474
[junit4:junit4] 2> 984091 T2709 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:54137/solr/replication&command=fetchindex&wait=true} status=0 QTime=76
[junit4:junit4] 2> 984096 T2699 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:(empty1+empty2+empty3+empty4)&wt=javabin&version=2} hits=4 status=0 QTime=1
[junit4:junit4] 2> 984103 T2712 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:(empty1+empty2+empty3+empty4)&wt=javabin&version=2} hits=4 status=0 QTime=1
[junit4:junit4] 2> 984107 T2700 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 984113 T2701 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 984123 T2702 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 984125 T2711 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=6
[junit4:junit4] 2> 984130 T2697 C4467 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 984134 T2713 C4466 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 984135 T2693 oas.SolrTestCaseJ4.tearDown ###Ending testEmptyCommits
[junit4:junit4] 2> 984154 T2693 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1649211546
[junit4:junit4] 2> 984157 T2693 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7b01e273
[junit4:junit4] 2> 984159 T2693 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 984159 T2693 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 984159 T2693 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 984160 T2693 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 984161 T2693 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 984161 T2693 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 984163 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\;done=false>>]
[junit4:junit4] 2> 984163 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\
[junit4:junit4] 2> 984163 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\index;done=false>>]
[junit4:junit4] 2> 984164 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490011810\master\collection1\data\index
[junit4:junit4] 2> 984165 T2693 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 984246 T2693 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=264611552
[junit4:junit4] 2> 984248 T2693 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1c76784d
[junit4:junit4] 2> 984251 T2693 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 984252 T2693 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 984252 T2693 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 984252 T2693 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 984255 T2693 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 984257 T2693 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 984258 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\;done=false>>]
[junit4:junit4] 2> 984259 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\
[junit4:junit4] 2> 984259 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index;done=false>>]
[junit4:junit4] 2> 984259 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490012377\slave\collection1\data\index
[junit4:junit4] 2> 984261 T2693 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 984363 T2693 oas.SolrTestCaseJ4.setUp ###Starting doTestIndexAndConfigAliasReplication
[junit4:junit4] 2> 984389 T2693 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 984395 T2693 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54150
[junit4:junit4] 2> 984396 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 984396 T2693 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 984397 T2693 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master
[junit4:junit4] 2> 984397 T2693 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\solr.xml
[junit4:junit4] 2> 984397 T2693 oasc.CoreContainer.<init> New CoreContainer 2089120249
[junit4:junit4] 2> 984400 T2693 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 984401 T2693 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\'
[junit4:junit4] 2> 984401 T2693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\'
[junit4:junit4] 2> 984568 T2693 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 984570 T2693 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 984570 T2693 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 984570 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 984571 T2693 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 984571 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 984573 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 984573 T2693 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 984573 T2693 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 984574 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 984586 T2693 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 984596 T2739 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1
[junit4:junit4] 2> 984597 T2739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\'
[junit4:junit4] 2> 984675 T2739 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 984781 T2739 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 984782 T2739 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 984791 T2739 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 984847 T2739 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 984853 T2739 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 984853 T2739 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\, dataDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\
[junit4:junit4] 2> 984854 T2739 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 984854 T2739 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 984856 T2739 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\
[junit4:junit4] 2> 984856 T2739 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index/
[junit4:junit4] 2> 984857 T2739 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 984862 T2739 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index
[junit4:junit4] 2> 984864 T2739 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_1,generation=1}
[junit4:junit4] 2> 984865 T2739 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 984867 T2739 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 984867 T2739 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 984867 T2739 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 984867 T2739 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 984868 T2739 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 984868 T2739 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 984876 T2739 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 984883 T2739 oass.SolrIndexSearcher.<init> Opening Searcher@1328844 main
[junit4:junit4] 2> 984883 T2739 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 984884 T2739 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 984884 T2739 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4:junit4] 2> 984884 T2739 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 984884 T2739 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 984886 T2740 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1328844 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 984887 T2693 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 984887 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 984889 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 984912 T2693 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 984918 T2693 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54153
[junit4:junit4] 2> 984919 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 984919 T2693 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 984919 T2693 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave
[junit4:junit4] 2> 984920 T2693 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\solr.xml
[junit4:junit4] 2> 984922 T2693 oasc.CoreContainer.<init> New CoreContainer 1500957385
[junit4:junit4] 2> 984925 T2693 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 984925 T2693 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\'
[junit4:junit4] 2> 984925 T2693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\'
[junit4:junit4] 2> 985049 T2693 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 985050 T2693 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 985050 T2693 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 985050 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 985050 T2693 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 985050 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 985051 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 985051 T2693 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 985053 T2693 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 985053 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 985061 T2693 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 985071 T2751 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1
[junit4:junit4] 2> 985072 T2751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\'
[junit4:junit4] 2> 985163 T2751 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 985282 T2751 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 985283 T2751 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 985289 T2751 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 985319 T2751 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 985322 T2751 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 985323 T2751 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\, dataDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\
[junit4:junit4] 2> 985323 T2751 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 985323 T2751 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 985325 T2751 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\
[junit4:junit4] 2> 985325 T2751 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index/
[junit4:junit4] 2> 985325 T2751 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 985326 T2751 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index
[junit4:junit4] 2> 985328 T2751 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dc09c8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4337cc50),segFN=segments_1,generation=1}
[junit4:junit4] 2> 985329 T2751 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 985330 T2751 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 985330 T2751 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 985332 T2751 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 985332 T2751 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 985332 T2751 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 985333 T2751 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 985336 T2751 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 985341 T2751 oass.SolrIndexSearcher.<init> Opening Searcher@2ffe10ef main
[junit4:junit4] 2> 985343 T2751 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 985343 T2751 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 985344 T2751 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4:junit4] 2> 985344 T2751 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 985344 T2752 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ffe10ef main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 985345 T2693 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 985347 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 985347 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C4468 name=collection1 org.apache.solr.core.SolrCore@4b9b1d12
[junit4:junit4] 2> 985369 T2733 C4468 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4:junit4] 2> 985376 T2738 C4468 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_1,generation=1}
[junit4:junit4] 2> 985379 T2738 C4468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 985380 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 6
[junit4:junit4] 2> 985384 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 1
[junit4:junit4] 2> 985388 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4:junit4] 2> 985394 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4:junit4] 2> 985398 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4:junit4] 2> 985403 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4:junit4] 2> 985409 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4:junit4] 2> 985413 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4:junit4] 2> 985421 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 1
[junit4:junit4] 2> 985425 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4:junit4] 2> 985431 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4:junit4] 2> 985435 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
[junit4:junit4] 2> 985441 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4:junit4] 2> 985446 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4:junit4] 2> 985450 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4:junit4] 2> 985457 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4:junit4] 2> 985461 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4:junit4] 2> 985467 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 1
[junit4:junit4] 2> 985472 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4:junit4] 2> 985478 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4:junit4] 2> 985483 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4:junit4] 2> 985488 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4:junit4] 2> 985493 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4:junit4] 2> 985500 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 1
[junit4:junit4] 2> 985504 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4:junit4] 2> 985510 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4:junit4] 2> 985514 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4:junit4] 2> 985519 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
[junit4:junit4] 2> 985525 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4:junit4] 2> 985530 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4:junit4] 2> 985536 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 1
[junit4:junit4] 2> 985540 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4:junit4] 2> 985547 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4:junit4] 2> 985552 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 1
[junit4:junit4] 2> 985558 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 1
[junit4:junit4] 2> 985562 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4:junit4] 2> 985569 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 1
[junit4:junit4] 2> 985573 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4:junit4] 2> 985579 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4:junit4] 2> 985584 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
[junit4:junit4] 2> 985591 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 1
[junit4:junit4] 2> 985595 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4:junit4] 2> 985601 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4:junit4] 2> 985608 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 2
[junit4:junit4] 2> 985613 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4:junit4] 2> 985617 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4:junit4] 2> 985621 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4:junit4] 2> 985627 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4:junit4] 2> 985633 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
[junit4:junit4] 2> 985642 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4:junit4] 2> 985645 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4:junit4] 2> 985653 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4:junit4] 2> 985656 T2733 C4468 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 985666 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 2
[junit4:junit4] 2> 985670 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4:junit4] 2> 985677 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 2
[junit4:junit4] 2> 985682 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 1
[junit4:junit4] 2> 985686 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4:junit4] 2> 985692 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4:junit4] 2> 985697 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4:junit4] 2> 985703 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
[junit4:junit4] 2> 985707 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4:junit4] 2> 985711 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4:junit4] 2> 985718 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 1
[junit4:junit4] 2> 985724 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 2
[junit4:junit4] 2> 985729 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 1
[junit4:junit4] 2> 985735 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 2
[junit4:junit4] 2> 985740 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4:junit4] 2> 985744 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4:junit4] 2> 985751 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 1
[junit4:junit4] 2> 985755 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4:junit4] 2> 985762 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 1
[junit4:junit4] 2> 985766 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4:junit4] 2> 985772 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4:junit4] 2> 985779 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 2
[junit4:junit4] 2> 985782 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4:junit4] 2> 985786 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 0
[junit4:junit4] 2> 985790 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 0
[junit4:junit4] 2> 985794 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
[junit4:junit4] 2> 985799 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4:junit4] 2> 985804 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 0
[junit4:junit4] 2> 985809 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 0
[junit4:junit4] 2> 985816 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 1
[junit4:junit4] 2> 985822 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 2
[junit4:junit4] 2> 985826 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4:junit4] 2> 985830 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4:junit4] 2> 985834 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 0
[junit4:junit4] 2> 985840 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4:junit4] 2> 985846 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 1
[junit4:junit4] 2> 985852 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 1
[junit4:junit4] 2> 985857 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 1
[junit4:junit4] 2> 985863 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4:junit4] 2> 985867 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4:junit4] 2> 985873 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4:junit4] 2> 985878 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 1
[junit4:junit4] 2> 985884 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 2
[junit4:junit4] 2> 985889 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4:junit4] 2> 985893 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 0
[junit4:junit4] 2> 985900 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 1
[junit4:junit4] 2> 985906 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 2
[junit4:junit4] 2> 985911 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 0
[junit4:junit4] 2> 985915 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 0
[junit4:junit4] 2> 985920 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 0
[junit4:junit4] 2> 985924 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4:junit4] 2> 985929 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4:junit4] 2> 985933 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4:junit4] 2> 985938 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4:junit4] 2> 985943 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4:junit4] 2> 985947 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 0
[junit4:junit4] 2> 985953 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 0
[junit4:junit4] 2> 985958 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4:junit4] 2> 985964 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4:junit4] 2> 985968 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4:junit4] 2> 985975 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 2
[junit4:junit4] 2> 985979 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4:junit4] 2> 985983 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4:junit4] 2> 985989 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4:junit4] 2> 985993 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 0
[junit4:junit4] 2> 985998 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4:junit4] 2> 986004 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4:junit4] 2> 986009 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 0
[junit4:junit4] 2> 986013 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 0
[junit4:junit4] 2> 986019 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 0
[junit4:junit4] 2> 986023 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 0
[junit4:junit4] 2> 986029 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 0
[junit4:junit4] 2> 986034 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4:junit4] 2> 986038 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4:junit4] 2> 986044 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 0
[junit4:junit4] 2> 986049 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4:junit4] 2> 986053 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4:junit4] 2> 986059 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4:junit4] 2> 986063 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4:junit4] 2> 986069 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4:junit4] 2> 986073 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4:junit4] 2> 986078 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4:junit4] 2> 986082 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4:junit4] 2> 986088 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4:junit4] 2> 986092 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 0
[junit4:junit4] 2> 986098 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 0
[junit4:junit4] 2> 986103 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4:junit4] 2> 986110 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 1
[junit4:junit4] 2> 986114 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4:junit4] 2> 986120 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 0
[junit4:junit4] 2> 986125 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4:junit4] 2> 986131 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4:junit4] 2> 986136 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4:junit4] 2> 986142 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4:junit4] 2> 986147 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 1
[junit4:junit4] 2> 986151 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 0
[junit4:junit4] 2> 986157 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 0
[junit4:junit4] 2> 986161 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 0
[junit4:junit4] 2> 986168 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 1
[junit4:junit4] 2> 986172 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4:junit4] 2> 986178 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4:junit4] 2> 986183 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 0
[junit4:junit4] 2> 986187 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 0
[junit4:junit4] 2> 986193 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 0
[junit4:junit4] 2> 986197 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4:junit4] 2> 986202 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 0
[junit4:junit4] 2> 986207 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 0
[junit4:junit4] 2> 986212 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 0
[junit4:junit4] 2> 986218 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 0
[junit4:junit4] 2> 986222 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 0
[junit4:junit4] 2> 986226 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 0
[junit4:junit4] 2> 986231 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4:junit4] 2> 986237 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 0
[junit4:junit4] 2> 986241 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 0
[junit4:junit4] 2> 986247 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 0
[junit4:junit4] 2> 986252 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 0
[junit4:junit4] 2> 986258 T2733 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 0
[junit4:junit4] 2> 986262 T2734 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 0
[junit4:junit4] 2> 986267 T2736 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 0
[junit4:junit4] 2> 986274 T2738 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 1
[junit4:junit4] 2> 986281 T2737 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 0
[junit4:junit4] 2> 986287 T2735 C4468 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 0
[junit4:junit4] 2> ASYNC NEW_CORE C4469 name=collection1 org.apache.solr.core.SolrCore@4b9b1d12
[junit4:junit4] 2> 986299 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 0
[junit4:junit4] 2> 986303 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 0
[junit4:junit4] 2> 986307 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 0
[junit4:junit4] 2> 986312 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 0
[junit4:junit4] 2> 986317 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 0
[junit4:junit4] 2> 986323 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 0
[junit4:junit4] 2> 986328 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 0
[junit4:junit4] 2> 986334 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 0
[junit4:junit4] 2> 986338 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 0
[junit4:junit4] 2> 986343 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 0
[junit4:junit4] 2> 986347 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 0
[junit4:junit4] 2> 986353 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 0
[junit4:junit4] 2> 986358 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 0
[junit4:junit4] 2> 986363 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 0
[junit4:junit4] 2> 986368 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 0
[junit4:junit4] 2> 986374 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 0
[junit4:junit4] 2> 986378 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 0
[junit4:junit4] 2> 986383 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 0
[junit4:junit4] 2> 986389 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 0
[junit4:junit4] 2> 986394 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 0
[junit4:junit4] 2> 986400 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 0
[junit4:junit4] 2> 986405 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 0
[junit4:junit4] 2> 986411 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 0
[junit4:junit4] 2> 986416 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 0
[junit4:junit4] 2> 986422 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 0
[junit4:junit4] 2> 986427 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 0
[junit4:junit4] 2> 986433 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 0
[junit4:junit4] 2> 986437 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 0
[junit4:junit4] 2> 986443 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 0
[junit4:junit4] 2> 986448 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 0
[junit4:junit4] 2> 986454 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 0
[junit4:junit4] 2> 986458 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 0
[junit4:junit4] 2> 986462 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 0
[junit4:junit4] 2> 986467 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[207]} 0 0
[junit4:junit4] 2> 986473 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[208]} 0 0
[junit4:junit4] 2> 986477 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[209]} 0 0
[junit4:junit4] 2> 986481 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[210]} 0 0
[junit4:junit4] 2> 986485 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[211]} 0 0
[junit4:junit4] 2> 986491 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[212]} 0 0
[junit4:junit4] 2> 986496 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[213]} 0 0
[junit4:junit4] 2> 986501 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[214]} 0 0
[junit4:junit4] 2> 986506 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[215]} 0 0
[junit4:junit4] 2> 986513 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[216]} 0 0
[junit4:junit4] 2> 986517 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[217]} 0 0
[junit4:junit4] 2> 986521 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[218]} 0 0
[junit4:junit4] 2> 986525 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[219]} 0 0
[junit4:junit4] 2> 986531 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[220]} 0 0
[junit4:junit4] 2> 986536 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[221]} 0 0
[junit4:junit4] 2> 986541 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[222]} 0 0
[junit4:junit4] 2> 986546 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[223]} 0 0
[junit4:junit4] 2> 986552 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[224]} 0 0
[junit4:junit4] 2> 986557 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[225]} 0 0
[junit4:junit4] 2> 986563 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[226]} 0 0
[junit4:junit4] 2> 986568 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[227]} 0 0
[junit4:junit4] 2> 986572 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[228]} 0 0
[junit4:junit4] 2> 986578 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[229]} 0 0
[junit4:junit4] 2> 986582 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[230]} 0 0
[junit4:junit4] 2> 986588 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[231]} 0 0
[junit4:junit4] 2> 986592 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[232]} 0 0
[junit4:junit4] 2> 986597 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[233]} 0 0
[junit4:junit4] 2> 986603 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[234]} 0 0
[junit4:junit4] 2> 986607 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[235]} 0 0
[junit4:junit4] 2> 986611 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[236]} 0 0
[junit4:junit4] 2> 986615 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[237]} 0 0
[junit4:junit4] 2> 986619 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[238]} 0 0
[junit4:junit4] 2> 986625 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[239]} 0 0
[junit4:junit4] 2> 986630 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[240]} 0 1
[junit4:junit4] 2> 986634 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[241]} 0 0
[junit4:junit4] 2> 986640 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[242]} 0 0
[junit4:junit4] 2> 986646 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[243]} 0 0
[junit4:junit4] 2> 986652 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[244]} 0 1
[junit4:junit4] 2> 986657 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[245]} 0 0
[junit4:junit4] 2> 986662 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[246]} 0 0
[junit4:junit4] 2> 986666 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[247]} 0 0
[junit4:junit4] 2> 986670 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[248]} 0 0
[junit4:junit4] 2> 986676 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[249]} 0 0
[junit4:junit4] 2> 986683 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[250]} 0 2
[junit4:junit4] 2> 986687 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[251]} 0 0
[junit4:junit4] 2> 986691 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[252]} 0 0
[junit4:junit4] 2> 986697 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[253]} 0 0
[junit4:junit4] 2> 986702 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[254]} 0 0
[junit4:junit4] 2> 986708 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[255]} 0 0
[junit4:junit4] 2> 986713 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[256]} 0 0
[junit4:junit4] 2> 986717 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[257]} 0 0
[junit4:junit4] 2> 986723 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[258]} 0 0
[junit4:junit4] 2> 986728 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[259]} 0 0
[junit4:junit4] 2> 986732 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[260]} 0 0
[junit4:junit4] 2> 986737 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[261]} 0 0
[junit4:junit4] 2> 986742 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[262]} 0 0
[junit4:junit4] 2> 986748 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[263]} 0 0
[junit4:junit4] 2> 986752 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[264]} 0 0
[junit4:junit4] 2> 986757 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[265]} 0 0
[junit4:junit4] 2> 986763 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[266]} 0 2
[junit4:junit4] 2> 986768 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[267]} 0 1
[junit4:junit4] 2> 986772 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[268]} 0 0
[junit4:junit4] 2> 986778 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[269]} 0 1
[junit4:junit4] 2> 986784 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[270]} 0 0
[junit4:junit4] 2> 986789 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[271]} 0 0
[junit4:junit4] 2> 986795 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[272]} 0 0
[junit4:junit4] 2> 986800 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[273]} 0 0
[junit4:junit4] 2> 986806 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[274]} 0 0
[junit4:junit4] 2> 986810 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[275]} 0 0
[junit4:junit4] 2> 986815 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[276]} 0 0
[junit4:junit4] 2> 986821 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[277]} 0 0
[junit4:junit4] 2> 986825 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[278]} 0 0
[junit4:junit4] 2> 986830 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[279]} 0 0
[junit4:junit4] 2> 986835 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[280]} 0 0
[junit4:junit4] 2> 986840 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[281]} 0 0
[junit4:junit4] 2> 986846 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[282]} 0 0
[junit4:junit4] 2> 986851 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[283]} 0 0
[junit4:junit4] 2> 986857 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[284]} 0 0
[junit4:junit4] 2> 986864 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[285]} 0 2
[junit4:junit4] 2> 986868 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[286]} 0 0
[junit4:junit4] 2> 986875 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[287]} 0 2
[junit4:junit4] 2> 986880 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[288]} 0 0
[junit4:junit4] 2> 986887 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[289]} 0 1
[junit4:junit4] 2> 986893 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[290]} 0 2
[junit4:junit4] 2> 986898 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[291]} 0 0
[junit4:junit4] 2> 986905 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[292]} 0 0
[junit4:junit4] 2> 986909 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[293]} 0 0
[junit4:junit4] 2> 986915 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[294]} 0 0
[junit4:junit4] 2> 986922 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[295]} 0 2
[junit4:junit4] 2> 986927 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[296]} 0 1
[junit4:junit4] 2> 986933 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[297]} 0 2
[junit4:junit4] 2> 986938 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[298]} 0 1
[junit4:junit4] 2> 986944 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[299]} 0 2
[junit4:junit4] 2> 986951 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[300]} 0 2
[junit4:junit4] 2> 986956 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[301]} 0 1
[junit4:junit4] 2> 986960 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[302]} 0 0
[junit4:junit4] 2> 986966 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[303]} 0 0
[junit4:junit4] 2> 986974 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[304]} 0 1
[junit4:junit4] 2> 986978 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[305]} 0 0
[junit4:junit4] 2> 986984 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[306]} 0 0
[junit4:junit4] 2> 986988 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[307]} 0 0
[junit4:junit4] 2> 986993 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[308]} 0 0
[junit4:junit4] 2> 986997 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[309]} 0 0
[junit4:junit4] 2> 987003 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[310]} 0 0
[junit4:junit4] 2> 987007 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[311]} 0 0
[junit4:junit4] 2> 987011 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[312]} 0 0
[junit4:junit4] 2> 987017 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[313]} 0 0
[junit4:junit4] 2> 987021 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[314]} 0 0
[junit4:junit4] 2> 987028 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[315]} 0 2
[junit4:junit4] 2> 987032 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[316]} 0 0
[junit4:junit4] 2> 987036 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[317]} 0 0
[junit4:junit4] 2> 987042 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[318]} 0 0
[junit4:junit4] 2> 987047 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[319]} 0 0
[junit4:junit4] 2> 987054 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[320]} 0 1
[junit4:junit4] 2> 987058 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[321]} 0 0
[junit4:junit4] 2> 987062 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[322]} 0 0
[junit4:junit4] 2> 987062 T2736 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 987066 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[323]} 0 0
[junit4:junit4] 2> 987072 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[324]} 0 0
[junit4:junit4] 2> 987077 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[325]} 0 0
[junit4:junit4] 2> 987083 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[326]} 0 0
[junit4:junit4] 2> 987090 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[327]} 0 1
[junit4:junit4] 2> 987094 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[328]} 0 0
[junit4:junit4] 2> 987100 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[329]} 0 0
[junit4:junit4] 2> 987106 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[330]} 0 1
[junit4:junit4] 2> 987111 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[331]} 0 0
[junit4:junit4] 2> 987116 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[332]} 0 0
[junit4:junit4] 2> 987120 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[333]} 0 0
[junit4:junit4] 2> 987126 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[334]} 0 0
[junit4:junit4] 2> 987131 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[335]} 0 0
[junit4:junit4] 2> 987137 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[336]} 0 0
[junit4:junit4] 2> 987141 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[337]} 0 0
[junit4:junit4] 2> 987146 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[338]} 0 0
[junit4:junit4] 2> 987152 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[339]} 0 0
[junit4:junit4] 2> 987158 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[340]} 0 2
[junit4:junit4] 2> 987163 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[341]} 0 0
[junit4:junit4] 2> 987167 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[342]} 0 0
[junit4:junit4] 2> 987174 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[343]} 0 1
[junit4:junit4] 2> 987178 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[344]} 0 0
[junit4:junit4] 2> 987185 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[345]} 0 1
[junit4:junit4] 2> 987191 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[346]} 0 0
[junit4:junit4] 2> 987196 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[347]} 0 0
[junit4:junit4] 2> 987202 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[348]} 0 0
[junit4:junit4] 2> 987209 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[349]} 0 2
[junit4:junit4] 2> 987213 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[350]} 0 0
[junit4:junit4] 2> 987217 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[351]} 0 0
[junit4:junit4] 2> 987222 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[352]} 0 0
[junit4:junit4] 2> 987229 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[353]} 0 0
[junit4:junit4] 2> 987236 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[354]} 0 0
[junit4:junit4] 2> 987244 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[355]} 0 1
[junit4:junit4] 2> 987250 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[356]} 0 1
[junit4:junit4] 2> 987254 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[357]} 0 0
[junit4:junit4] 2> 987260 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[358]} 0 0
[junit4:junit4] 2> 987267 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[359]} 0 0
[junit4:junit4] 2> 987272 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[360]} 0 0
[junit4:junit4] 2> 987278 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[361]} 0 0
[junit4:junit4] 2> 987286 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[362]} 0 2
[junit4:junit4] 2> 987291 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[363]} 0 0
[junit4:junit4] 2> 987296 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[364]} 0 0
[junit4:junit4] 2> 987300 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[365]} 0 0
[junit4:junit4] 2> 987305 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[366]} 0 0
[junit4:junit4] 2> 987312 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[367]} 0 0
[junit4:junit4] 2> 987318 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[368]} 0 0
[junit4:junit4] 2> 987325 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[369]} 0 2
[junit4:junit4] 2> 987330 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[370]} 0 0
[junit4:junit4] 2> 987336 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[371]} 0 0
[junit4:junit4] 2> 987344 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[372]} 0 2
[junit4:junit4] 2> 987348 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[373]} 0 0
[junit4:junit4] 2> 987353 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[374]} 0 0
[junit4:junit4] 2> 987360 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[375]} 0 0
[junit4:junit4] 2> 987366 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[376]} 0 1
[junit4:junit4] 2> 987370 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[377]} 0 0
[junit4:junit4] 2> 987377 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[378]} 0 0
[junit4:junit4] 2> 987382 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[379]} 0 0
[junit4:junit4] 2> 987389 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[380]} 0 1
[junit4:junit4] 2> 987395 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[381]} 0 0
[junit4:junit4] 2> 987399 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[382]} 0 0
[junit4:junit4] 2> 987405 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[383]} 0 0
[junit4:junit4] 2> 987411 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[384]} 0 0
[junit4:junit4] 2> 987418 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[385]} 0 0
[junit4:junit4] 2> 987422 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[386]} 0 0
[junit4:junit4] 2> 987428 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[387]} 0 0
[junit4:junit4] 2> 987435 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[388]} 0 0
[junit4:junit4] 2> 987440 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[389]} 0 0
[junit4:junit4] 2> 987449 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[390]} 0 2
[junit4:junit4] 2> 987453 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[391]} 0 0
[junit4:junit4] 2> 987458 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[392]} 0 0
[junit4:junit4] 2> 987463 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[393]} 0 0
[junit4:junit4] 2> 987468 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[394]} 0 0
[junit4:junit4] 2> 987474 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[395]} 0 0
[junit4:junit4] 2> 987479 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[396]} 0 0
[junit4:junit4] 2> 987483 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[397]} 0 0
[junit4:junit4] 2> 987490 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[398]} 0 0
[junit4:junit4] 2> 987494 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[399]} 0 0
[junit4:junit4] 2> 987498 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[400]} 0 0
[junit4:junit4] 2> 987504 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[401]} 0 0
[junit4:junit4] 2> 987509 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[402]} 0 1
[junit4:junit4] 2> 987514 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[403]} 0 0
[junit4:junit4] 2> 987519 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[404]} 0 0
[junit4:junit4] 2> 987523 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[405]} 0 0
[junit4:junit4] 2> 987529 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[406]} 0 0
[junit4:junit4] 2> 987536 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[407]} 0 0
[junit4:junit4] 2> 987540 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[408]} 0 0
[junit4:junit4] 2> 987544 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[409]} 0 0
[junit4:junit4] 2> 987548 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[410]} 0 0
[junit4:junit4] 2> 987554 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[411]} 0 0
[junit4:junit4] 2> 987558 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[412]} 0 0
[junit4:junit4] 2> 987563 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[413]} 0 0
[junit4:junit4] 2> 987569 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[414]} 0 0
[junit4:junit4] 2> 987574 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[415]} 0 0
[junit4:junit4] 2> 987578 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[416]} 0 0
[junit4:junit4] 2> 987585 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[417]} 0 0
[junit4:junit4] 2> 987589 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[418]} 0 0
[junit4:junit4] 2> 987594 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[419]} 0 0
[junit4:junit4] 2> 987599 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[420]} 0 0
[junit4:junit4] 2> 987605 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[421]} 0 0
[junit4:junit4] 2> 987609 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[422]} 0 0
[junit4:junit4] 2> 987614 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[423]} 0 0
[junit4:junit4] 2> 987618 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[424]} 0 0
[junit4:junit4] 2> 987624 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[425]} 0 0
[junit4:junit4] 2> 987628 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[426]} 0 0
[junit4:junit4] 2> 987634 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[427]} 0 0
[junit4:junit4] 2> 987638 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[428]} 0 0
[junit4:junit4] 2> 987643 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[429]} 0 0
[junit4:junit4] 2> 987650 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[430]} 0 0
[junit4:junit4] 2> 987654 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[431]} 0 0
[junit4:junit4] 2> 987658 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[432]} 0 0
[junit4:junit4] 2> 987665 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[433]} 0 0
[junit4:junit4] 2> 987669 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[434]} 0 0
[junit4:junit4] 2> 987674 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[435]} 0 0
[junit4:junit4] 2> 987681 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[436]} 0 2
[junit4:junit4] 2> 987686 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[437]} 0 0
[junit4:junit4] 2> 987691 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[438]} 0 0
[junit4:junit4] 2> 987695 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[439]} 0 0
[junit4:junit4] 2> 987700 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[440]} 0 0
[junit4:junit4] 2> 987705 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[441]} 0 0
[junit4:junit4] 2> 987710 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[442]} 0 1
[junit4:junit4] 2> 987715 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[443]} 0 0
[junit4:junit4] 2> 987719 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[444]} 0 0
[junit4:junit4] 2> 987724 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[445]} 0 0
[junit4:junit4] 2> 987729 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[446]} 0 0
[junit4:junit4] 2> 987735 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[447]} 0 0
[junit4:junit4] 2> 987741 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[448]} 0 1
[junit4:junit4] 2> 987745 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[449]} 0 0
[junit4:junit4] 2> 987751 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[450]} 0 1
[junit4:junit4] 2> 987756 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[451]} 0 0
[junit4:junit4] 2> 987760 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[452]} 0 0
[junit4:junit4] 2> 987765 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[453]} 0 1
[junit4:junit4] 2> 987769 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[454]} 0 0
[junit4:junit4] 2> 987774 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[455]} 0 0
[junit4:junit4] 2> 987780 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[456]} 0 0
[junit4:junit4] 2> 987784 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[457]} 0 0
[junit4:junit4] 2> 987787 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[458]} 0 0
[junit4:junit4] 2> 987792 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[459]} 0 0
[junit4:junit4] 2> 987797 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[460]} 0 0
[junit4:junit4] 2> 987802 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[461]} 0 0
[junit4:junit4] 2> 987807 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[462]} 0 0
[junit4:junit4] 2> 987812 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[463]} 0 0
[junit4:junit4] 2> 987817 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[464]} 0 0
[junit4:junit4] 2> 987821 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[465]} 0 0
[junit4:junit4] 2> 987826 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[466]} 0 0
[junit4:junit4] 2> 987831 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[467]} 0 0
[junit4:junit4] 2> 987835 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[468]} 0 0
[junit4:junit4] 2> 987840 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[469]} 0 0
[junit4:junit4] 2> 987843 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[470]} 0 0
[junit4:junit4] 2> 987847 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[471]} 0 0
[junit4:junit4] 2> 987851 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[472]} 0 0
[junit4:junit4] 2> 987854 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[473]} 0 0
[junit4:junit4] 2> 987858 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[474]} 0 0
[junit4:junit4] 2> 987863 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[475]} 0 0
[junit4:junit4] 2> 987867 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[476]} 0 0
[junit4:junit4] 2> 987871 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[477]} 0 0
[junit4:junit4] 2> 987874 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[478]} 0 0
[junit4:junit4] 2> 987878 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[479]} 0 0
[junit4:junit4] 2> 987882 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[480]} 0 0
[junit4:junit4] 2> 987886 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[481]} 0 0
[junit4:junit4] 2> 987889 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[482]} 0 0
[junit4:junit4] 2> 987893 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[483]} 0 0
[junit4:junit4] 2> 987898 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[484]} 0 0
[junit4:junit4] 2> 987902 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[485]} 0 0
[junit4:junit4] 2> 987907 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[486]} 0 0
[junit4:junit4] 2> 987912 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[487]} 0 0
[junit4:junit4] 2> 987915 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[488]} 0 0
[junit4:junit4] 2> 987922 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[489]} 0 0
[junit4:junit4] 2> 987927 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[490]} 0 2
[junit4:junit4] 2> 987930 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[491]} 0 0
[junit4:junit4] 2> 987934 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[492]} 0 0
[junit4:junit4] 2> 987939 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[493]} 0 0
[junit4:junit4] 2> 987944 T2736 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[494]} 0 0
[junit4:junit4] 2> 987949 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[495]} 0 0
[junit4:junit4] 2> 987954 T2738 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[496]} 0 1
[junit4:junit4] 2> 987959 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[497]} 0 0
[junit4:junit4] 2> 987963 T2733 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[498]} 0 0
[junit4:junit4] 2> 987969 T2737 C4469 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 987999 T2737 C4469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_2,generation=2}
[junit4:junit4] 2> 988000 T2737 C4469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 988001 T2737 C4469 oass.SolrIndexSearcher.<init> Opening Searcher@6bbf3a21 main
[junit4:junit4] 2> 988002 T2737 C4469 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 988033 T2740 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6bbf3a21 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):c499)}
[junit4:junit4] 2> 988035 T2737 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 66
[junit4:junit4] 2> 988042 T2736 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=499 status=0 QTime=4
[junit4:junit4] 2> ASYNC NEW_CORE C4470 name=collection1 org.apache.solr.core.SolrCore@321130fa
[junit4:junit4] 2> 988061 T2749 C4470 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=2
[junit4:junit4] 2> 988062 T2693 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 988195 T2745 C4470 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 988196 T2693 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 988328 T2747 C4470 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=2
[junit4:junit4] 2> 988329 T2693 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 988391 T2734 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 988392 T2753 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 988392 T2753 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 988392 T2753 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 988401 T2735 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=5
[junit4:junit4] 2> 988402 T2753 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
[junit4:junit4] 2> 988403 T2753 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index.20130617202657842
[junit4:junit4] 2> 988405 T2753 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5b3c7582 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7a1136f7) fullCopy=false
[junit4:junit4] 2> 988407 T2733 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.cfs&command=filecontent&checksum=true&compression=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 988415 T2737 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.cfe&command=filecontent&checksum=true&compression=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 988420 T2736 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&compression=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 988426 T2738 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&compression=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 988428 T2753 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 988432 T2753 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 988432 T2753 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 988436 T2753 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dc09c8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4337cc50),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dc09c8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4337cc50),segFN=segments_2,generation=2}
[junit4:junit4] 2> 988437 T2753 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 988437 T2753 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 988438 T2753 oass.SolrIndexSearcher.<init> Opening Searcher@9113f94 main
[junit4:junit4] 2> 988438 T2752 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9113f94 main{StandardDirectoryReader(segments_2:3:nrt _0(4.4):c499)}
[junit4:junit4] 2> 988439 T2753 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index.20130617202657842 [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index.20130617202657842;done=true>>]
[junit4:junit4] 2> 988439 T2753 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index.20130617202657842
[junit4:junit4] 2> 988439 T2753 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index.20130617202657842
[junit4:junit4] 2> 988461 T2748 C4470 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=499 status=0 QTime=2
[junit4:junit4] 2> 988467 T2734 C4469 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4:junit4] 2> 988469 T2734 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 2
[junit4:junit4] 2> 988474 T2735 C4469 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 988476 T2735 C4469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30983577 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71ba2933),segFN=segments_3,generation=3}
[junit4:junit4] 2> 988476 T2735 C4469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 988477 T2735 C4469 oass.SolrIndexSearcher.<init> Opening Searcher@e781707 main
[junit4:junit4] 2> 988478 T2735 C4469 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 988478 T2740 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e781707 main{StandardDirectoryReader(segments_3:4:nrt)}
[junit4:junit4] 2> 988479 T2735 C4469 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 988483 T2733 C4469 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 988513 T2693 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2089120249
[junit4:junit4] 2> 988513 T2693 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4b9b1d12
[junit4:junit4] 2> 988515 T2693 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=499,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 988515 T2693 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 988517 T2693 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 988517 T2693 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 988518 T2693 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 988519 T2693 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 988520 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\;done=false>>]
[junit4:junit4] 2> 988520 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\
[junit4:junit4] 2> 988521 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index;done=false>>]
[junit4:junit4] 2> 988521 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index
[junit4:junit4] 2> 988524 T2693 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 988577 T2693 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 988581 T2693 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54159
[junit4:junit4] 2> 988582 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 988584 T2693 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 988585 T2693 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master
[junit4:junit4] 2> 988585 T2693 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\solr.xml
[junit4:junit4] 2> 988586 T2693 oasc.CoreContainer.<init> New CoreContainer 1797231269
[junit4:junit4] 2> 988586 T2693 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 988587 T2693 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\'
[junit4:junit4] 2> 988587 T2693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\'
[junit4:junit4] 2> 988746 T2693 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 988748 T2693 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 988749 T2693 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 988749 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 988750 T2693 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 988750 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 988751 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 988751 T2693 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 988753 T2693 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 988754 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 988764 T2693 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 988772 T2765 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1
[junit4:junit4] 2> 988772 T2765 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\'
[junit4:junit4] 2> 988877 T2765 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 988993 T2765 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 988995 T2765 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 989001 T2765 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 989038 T2765 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 989042 T2765 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 989043 T2765 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\, dataDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\
[junit4:junit4] 2> 989043 T2765 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 989043 T2765 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 989044 T2765 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\
[junit4:junit4] 2> 989046 T2765 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index/
[junit4:junit4] 2> 989046 T2765 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 989047 T2765 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490013803\master\collection1\data\index
[junit4:junit4] 2> 989047 T2765 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@54226459 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@47c4617c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 989048 T2765 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 989051 T2765 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 989052 T2765 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 989052 T2765 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 989052 T2765 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 989052 T2765 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 989053 T2765 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 989056 T2765 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 989063 T2765 oass.SolrIndexSearcher.<init> Opening Searcher@1a051163 main
[junit4:junit4] 2> 989064 T2765 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 989064 T2765 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 989064 T2765 oash.ReplicationHandler.inform Replication enabled for following config files: schema-replication2.xml:schema.xml
[junit4:junit4] 2> 989064 T2765 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 989064 T2765 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 989066 T2766 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a051163 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 989068 T2693 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 989069 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 989069 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 989098 T2693 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1500957385
[junit4:junit4] 2> 989100 T2693 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@321130fa
[junit4:junit4] 2> 989103 T2693 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 989104 T2693 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 989105 T2693 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 989107 T2693 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 989108 T2693 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 989109 T2693 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 989110 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index;done=false>>]
[junit4:junit4] 2> 989111 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index
[junit4:junit4] 2> 989113 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\;done=false>>]
[junit4:junit4] 2> 989113 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\
[junit4:junit4] 2> 989114 T2693 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 989172 T2693 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 989177 T2693 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54162
[junit4:junit4] 2> 989180 T2693 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 989180 T2693 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 989181 T2693 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave
[junit4:junit4] 2> 989181 T2693 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\solr.xml
[junit4:junit4] 2> 989182 T2693 oasc.CoreContainer.<init> New CoreContainer 790425953
[junit4:junit4] 2> 989184 T2693 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 989184 T2693 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\'
[junit4:junit4] 2> 989185 T2693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\'
[junit4:junit4] 2> 989290 T2693 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 989292 T2693 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 989292 T2693 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 989293 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 989293 T2693 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 989294 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 989294 T2693 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 989294 T2693 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 989295 T2693 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 989295 T2693 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 989302 T2693 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 989308 T2777 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1
[junit4:junit4] 2> 989308 T2777 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\'
[junit4:junit4] 2> 989380 T2777 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 989456 T2777 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 989456 T2777 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 989461 T2777 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 989487 T2777 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 989489 T2777 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 989489 T2777 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\, dataDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\
[junit4:junit4] 2> 989489 T2777 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 989490 T2777 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 989490 T2777 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\
[junit4:junit4] 2> 989490 T2777 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index/
[junit4:junit4] 2> 989492 T2777 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 989493 T2777 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490014336\slave\collection1\data\index
[junit4:junit4] 2> 989494 T2777 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41defa7a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@25480b03),segFN=segments_1,generation=1}
[junit4:junit4] 2> 989494 T2777 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 989495 T2777 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 989495 T2777 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 989495 T2777 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 989497 T2777 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 989497 T2777 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 989497 T2777 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 989500 T2777 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 989505 T2777 oass.SolrIndexSearcher.<init> Opening Searcher@e016c93 main
[junit4:junit4] 2> 989505 T2777 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 989505 T2777 oasu.CommitTracker.<i
[...truncated too long message...]
rCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=493 status=0 QTime=0
[junit4:junit4] 2> 1063041 T2693 oas.SolrTestCaseJ4.tearDown ###Ending doTestStopPoll
[junit4:junit4] 2> 1063053 T2693 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1770084784
[junit4:junit4] 2> 1063053 T2693 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3a93246c
[junit4:junit4] 2> 1063054 T2693 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=493,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 1063054 T2693 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1063054 T2693 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1063054 T2693 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1063055 T2693 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1063055 T2693 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1063056 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086613\master\collection1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086613\master\collection1\data\index;done=false>>]
[junit4:junit4] 2> 1063056 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086613\master\collection1\data\index
[junit4:junit4] 2> 1063056 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086613\master\collection1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086613\master\collection1\data\;done=false>>]
[junit4:junit4] 2> 1063056 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086613\master\collection1\data\
[junit4:junit4] 2> 1063057 T2693 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 1063121 T2693 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1764047864
[junit4:junit4] 2> 1063122 T2693 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@133df096
[junit4:junit4] 2> 1063123 T2693 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 1063124 T2693 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1063124 T2693 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1063124 T2693 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1063126 T2693 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1063126 T2693 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1063126 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086896\slave\collection1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086896\slave\collection1\data\;done=false>>]
[junit4:junit4] 2> 1063127 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086896\slave\collection1\data\
[junit4:junit4] 2> 1063128 T2693 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086896\slave\collection1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086896\slave\collection1\data\index;done=false>>]
[junit4:junit4] 2> 1063128 T2693 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1371490086896\slave\collection1\data\index
[junit4:junit4] 2> 1063129 T2693 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 1063204 T2693 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {newname=PostingsFormat(name=Asserting), id=PostingsFormat(name=Asserting), name=PostingsFormat(name=Asserting)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=es_CL, timezone=Europe/Kiev
[junit4:junit4] 2> NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_45 (64-bit)/cpus=2,threads=1,free=40637800,total=183250944
[junit4:junit4] 2> NOTE: All tests run in this JVM: [FieldAnalysisRequestHandlerTest, TestFastLRUCache, TestFoldingMultitermQuery, StatsComponentTest, LoggingHandlerTest, HardAutoCommitTest, CopyFieldTest, TestFunctionQuery, BasicZkTest, TestIBSimilarityFactory, FieldMutatingUpdateProcessorTest, ZkSolrClientTest, TestSolrIndexConfig, MoreLikeThisHandlerTest, LukeRequestHandlerTest, MultiTermTest, PreAnalyzedUpdateProcessorTest, TestWriterPerf, ExternalFileFieldSortTest, SolrIndexSplitterTest, TestSurroundQueryParser, TestShardHandlerFactory, TestStressRecovery, DisMaxRequestHandlerTest, TestSerializedLuceneMatchVersion, ChaosMonkeyShardSplitTest, BadComponentTest, TestNumberUtils, DirectUpdateHandlerTest, AlternateDirectoryTest, BadCopyFieldTest, TestPluginEnable, TestSchemaResource, PluginInfoTest, DocValuesMultiTest, CSVRequestHandlerTest, TestSchemaNameResource, NumericFieldsTest, TestPostingsSolrHighlighter, TestRemoteStreaming, TestLuceneMatchVersion, TermVectorComponentDistributedTest, TestExtendedDismaxParser, WordBreakSolrSpellCheckerTest, SpellPossibilityIteratorTest, SoftAutoCommitTest, SuggesterTSTTest, TestCSVLoader, SolrCoreCheckLockOnStartupTest, TestXIncludeConfig, SolrPluginUtilsTest, TestBinaryResponseWriter, TestSolrQueryParserResource, TestCoreContainer, TestDynamicFieldResource, TestFastOutputStream, SolrIndexConfigTest, TestMaxScoreQueryParser, TestPerFieldSimilarity, SuggesterTest, HighlighterTest, CacheHeaderTest, CurrencyFieldOpenExchangeTest, TestSweetSpotSimilarityFactory, TestUtils, TestStressVersions, BinaryUpdateRequestHandlerTest, AliasIntegrationTest, DistanceFunctionTest, SampleTest, TestSolrXml, PrimitiveFieldTypeTest, DocValuesTest, TestUpdate, PathHierarchyTokenizerFactoryTest, ConvertedLegacyTest, TestAtomicUpdateErrorCases, CachingDirectoryFactoryTest, TestSystemIdResolver, PolyFieldTest, TestBadConfig, RequiredFieldsTest, TestBinaryField, TestSolr4Spatial, XmlUpdateRequestHandlerTest, TestLRUCache, BadIndexSchemaTest, TestSolrQueryParser, TestClassNameShortening, TestLFUCache, TestPhraseSuggestions, ChaosMonkeySafeLeaderTest, TestSolrJ, TestArbitraryIndexDir, TestRandomFaceting, QueryResultKeyTest, DistributedQueryElevationComponentTest, TestTrie, TestAnalyzedSuggestions, TestSolrQueryParserDefaultOperatorResource, OpenExchangeRatesOrgProviderTest, TestManagedSchemaFieldResource, TestStressLucene, FullSolrCloudDistribCmdsTest, ShardRoutingTest, TestPHPSerializedResponseWriter, TestSort, BasicFunctionalityTest, TestDynamicFieldCollectionResource, ZkControllerTest, FastVectorHighlighterTest, TestElisionMultitermQuery, DefaultValueUpdateProcessorTest, DirectSolrConnectionTest, TestSolrXMLSerializer, TestIndexSearcher, TestRangeQuery, TestFiltering, QueryElevationComponentTest, TestFieldCollectionResource, ShowFileRequestHandlerTest, SliceStateTest, PrimUtilsTest, DistributedTermsComponentTest, TestMultiCoreConfBootstrap, StatelessScriptUpdateProcessorFactoryTest, OpenCloseCoreStressTest, UUIDFieldTest, SuggesterFSTTest, TestWordDelimiterFilterFactory, TestPseudoReturnFields, TermsComponentTest, StandardRequestHandlerTest, SliceStateUpdateTest, TestReplicationHandler]
[junit4:junit4] Completed in 80.89s, 13 tests, 1 failure <<< FAILURES!
[...truncated 491 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1252 tests, 1 failure, 20 ignored (14 assumptions)
Total time: 68 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0_45 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_21) - Build #
2900 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2900/
Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([AED3CB3C28300DDA]:0)
REGRESSION: org.apache.solr.logging.TestLogWatcher.testLog4jWatcher
Error Message:
expected:<2> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<1>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.logging.TestLogWatcher.testLog4jWatcher(TestLogWatcher.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:180)
at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:275)
at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12)
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([AED3CB3C28300DDA]:0)
Build Log:
[...truncated 9887 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 1481241 T4267 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wt_nn/eo
[junit4:junit4] 2> 1481247 T4267 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1371455065937
[junit4:junit4] 2> 1481250 T4267 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1481251 T4268 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1481350 T4267 oasc.ZkTestServer.run start zk server on port:62015
[junit4:junit4] 2> 1481353 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1481373 T4274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53c761 name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1481373 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1481375 T4267 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1481389 T4269 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f51178f5b0000, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1481393 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1481399 T4276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@170553d name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1481400 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1481401 T4267 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1481409 T4267 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1481414 T4267 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1481418 T4267 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1481423 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1481424 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1481433 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1481433 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1481439 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1481440 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1481448 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1481449 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1481456 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1481456 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1481462 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1481463 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1481470 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1481471 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1481480 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1481481 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1481489 T4267 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1481491 T4267 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1481995 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1482003 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62022
[junit4:junit4] 2> 1482004 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1482004 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1482005 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192
[junit4:junit4] 2> 1482005 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192\solr.xml
[junit4:junit4] 2> 1482006 T4267 oasc.CoreContainer.<init> New CoreContainer 16616462
[junit4:junit4] 2> 1482006 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192\'
[junit4:junit4] 2> 1482007 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192\'
[junit4:junit4] 2> 1482123 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1482123 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1482124 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1482124 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1482125 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1482125 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1482125 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1482126 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1482126 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1482127 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1482134 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1482135 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1482135 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1482138 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1482149 T4287 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18da75d name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1482150 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1482154 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1482165 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1482169 T4289 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ab35ca name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1482169 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1482173 T4267 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1482179 T4267 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1482187 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1482192 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62022_wt_nn%2Feo
[junit4:junit4] 2> 1482194 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62022_wt_nn%2Feo
[junit4:junit4] 2> 1482199 T4267 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1482210 T4267 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1482214 T4267 oasc.Overseer.start Overseer (id=89879679201902595-127.0.0.1:62022_wt_nn%2Feo-n_0000000000) starting
[junit4:junit4] 2> 1482221 T4267 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1482229 T4291 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1482230 T4267 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1482236 T4267 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1482240 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1482244 T4290 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1482249 T4292 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1482249 T4292 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1483870 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1483872 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62022_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62022/wt_nn/eo"}
[junit4:junit4] 2> 1483872 T4290 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1483874 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1483898 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1484408 T4292 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192\collection1
[junit4:junit4] 2> 1484408 T4292 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1484410 T4292 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1484411 T4292 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1484418 T4292 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192\collection1\'
[junit4:junit4] 2> 1484422 T4292 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1484425 T4292 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192/collection1/lib/README' to classloader
[junit4:junit4] 2> 1484501 T4292 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1484579 T4292 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1484582 T4292 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1484589 T4292 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1485417 T4292 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1485430 T4292 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1485435 T4292 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1485456 T4292 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1485461 T4292 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1485467 T4292 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1485469 T4292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1485469 T4292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1485470 T4292 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1485472 T4292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1485472 T4292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1485472 T4292 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1485507 T4292 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371455066192\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/control/data\
[junit4:junit4] 2> 1485507 T4292 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1485508 T4292 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1485509 T4292 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\control\data
[junit4:junit4] 2> 1485509 T4292 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/control/data\index/
[junit4:junit4] 2> 1485511 T4292 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1485512 T4292 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\control\data\index
[junit4:junit4] 2> 1485522 T4292 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1485522 T4292 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1485528 T4292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1485528 T4292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1485529 T4292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1485529 T4292 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1485530 T4292 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1485530 T4292 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1485531 T4292 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1485532 T4292 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1485532 T4292 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1485544 T4292 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1485555 T4292 oass.SolrIndexSearcher.<init> Opening Searcher@10a4072 main
[junit4:junit4] 2> 1485558 T4292 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1485558 T4292 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1485565 T4292 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1485565 T4292 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62022/wt_nn/eo collection:control_collection shard:shard1
[junit4:junit4] 2> 1485570 T4292 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1485570 T4293 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10a4072 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1485589 T4292 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1485594 T4292 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1485594 T4292 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1485594 T4292 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62022/wt_nn/eo/collection1/
[junit4:junit4] 2> 1485594 T4292 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1485595 T4292 oasc.SyncStrategy.syncToMe http://127.0.0.1:62022/wt_nn/eo/collection1/ has no replicas
[junit4:junit4] 2> 1485595 T4292 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62022/wt_nn/eo/collection1/
[junit4:junit4] 2> 1485595 T4292 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1487151 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1487186 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1487254 T4292 oasc.ZkController.register We are http://127.0.0.1:62022/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62022/wt_nn/eo/collection1/
[junit4:junit4] 2> 1487255 T4292 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62022/wt_nn/eo
[junit4:junit4] 2> 1487255 T4292 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1487255 T4292 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1487256 T4292 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1487263 T4292 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1487266 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1487268 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1487269 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1487291 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1487296 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1487304 T4296 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab3a3d name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1487304 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1487309 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1487318 T4267 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1487858 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1487864 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62034
[junit4:junit4] 2> 1487866 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1487867 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1487867 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006
[junit4:junit4] 2> 1487868 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006\solr.xml
[junit4:junit4] 2> 1487869 T4267 oasc.CoreContainer.<init> New CoreContainer 22095120
[junit4:junit4] 2> 1487869 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006\'
[junit4:junit4] 2> 1487870 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006\'
[junit4:junit4] 2> 1488009 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1488009 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1488010 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1488011 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1488011 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1488012 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1488012 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1488012 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1488012 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1488013 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1488023 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1488024 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1488024 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1488027 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1488048 T4307 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c3b47b name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1488049 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1488054 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1488072 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1488080 T4309 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@97b75c name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1488081 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1488100 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1488828 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1488830 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62022_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62022/wt_nn/eo"}
[junit4:junit4] 2> 1488851 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1488851 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1488856 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1489189 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62034_wt_nn%2Feo
[junit4:junit4] 2> 1489195 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62034_wt_nn%2Feo
[junit4:junit4] 2> 1489205 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1489205 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1489206 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1489215 T4296 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1489217 T4309 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1489218 T4289 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1489238 T4310 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1489239 T4310 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1490505 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1490507 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62034_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62034/wt_nn/eo"}
[junit4:junit4] 2> 1490507 T4290 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 1490509 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1490539 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1490540 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1490542 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1491400 T4310 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006\collection1
[junit4:junit4] 2> 1491400 T4310 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1491403 T4310 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1491403 T4310 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1491410 T4310 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006\collection1\'
[junit4:junit4] 2> 1491415 T4310 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1491418 T4310 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006/collection1/lib/README' to classloader
[junit4:junit4] 2> 1491483 T4310 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1491554 T4310 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1491557 T4310 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1491562 T4310 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1492392 T4310 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1492404 T4310 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1492409 T4310 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1492430 T4310 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1492435 T4310 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1492440 T4310 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1492444 T4310 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1492445 T4310 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1492445 T4310 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1492447 T4310 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1492447 T4310 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1492447 T4310 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1492448 T4310 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371455072006\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty1\
[junit4:junit4] 2> 1492448 T4310 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1492448 T4310 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1492449 T4310 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1
[junit4:junit4] 2> 1492450 T4310 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty1\index/
[junit4:junit4] 2> 1492451 T4310 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1492451 T4310 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1\index
[junit4:junit4] 2> 1492466 T4310 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1492466 T4310 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1492470 T4310 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1492471 T4310 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1492471 T4310 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1492472 T4310 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1492473 T4310 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1492473 T4310 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1492473 T4310 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1492475 T4310 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1492475 T4310 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1492489 T4310 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1492499 T4310 oass.SolrIndexSearcher.<init> Opening Searcher@1df66d8 main
[junit4:junit4] 2> 1492503 T4310 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1492503 T4310 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1492510 T4311 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1df66d8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1492513 T4310 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1492513 T4310 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62034/wt_nn/eo collection:collection1 shard:shard1
[junit4:junit4] 2> 1492514 T4310 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1492537 T4310 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1492546 T4310 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1492546 T4310 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1492546 T4310 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62034/wt_nn/eo/collection1/
[junit4:junit4] 2> 1492546 T4310 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1492546 T4310 oasc.SyncStrategy.syncToMe http://127.0.0.1:62034/wt_nn/eo/collection1/ has no replicas
[junit4:junit4] 2> 1492546 T4310 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62034/wt_nn/eo/collection1/
[junit4:junit4] 2> 1492548 T4310 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1493741 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1493765 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1493766 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1493765 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1493812 T4310 oasc.ZkController.register We are http://127.0.0.1:62034/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62034/wt_nn/eo/collection1/
[junit4:junit4] 2> 1493812 T4310 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62034/wt_nn/eo
[junit4:junit4] 2> 1493813 T4310 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1493813 T4310 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1493814 T4310 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1493820 T4310 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1493823 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1493823 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1493824 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1494344 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1494349 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62043
[junit4:junit4] 2> 1494350 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1494351 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1494351 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526
[junit4:junit4] 2> 1494352 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526\solr.xml
[junit4:junit4] 2> 1494353 T4267 oasc.CoreContainer.<init> New CoreContainer 26589819
[junit4:junit4] 2> 1494354 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526\'
[junit4:junit4] 2> 1494355 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526\'
[junit4:junit4] 2> 1494485 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1494486 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1494487 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1494487 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1494487 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1494487 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1494488 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1494489 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1494489 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1494490 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1494497 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1494499 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1494499 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1494501 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1494520 T4323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@90e70b name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1494521 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1494524 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1494525 T4269 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f51178f5b0007, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1494533 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1494536 T4325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@80e3f4 name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1494536 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1494544 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1495280 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1495283 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62034_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62034/wt_nn/eo"}
[junit4:junit4] 2> 1495303 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495304 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495305 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495305 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495550 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62043_wt_nn%2Feo
[junit4:junit4] 2> 1495556 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62043_wt_nn%2Feo
[junit4:junit4] 2> 1495564 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495565 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495565 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1495570 T4325 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1495573 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1495580 T4296 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1495581 T4309 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1495584 T4289 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1495598 T4326 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1495599 T4326 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1496826 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1496828 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62043_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62043/wt_nn/eo"}
[junit4:junit4] 2> 1496828 T4290 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 1496829 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1496851 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1496852 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1496852 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1496852 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1497603 T4326 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526\collection1
[junit4:junit4] 2> 1497604 T4326 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1497606 T4326 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1497606 T4326 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1497613 T4326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526\collection1\'
[junit4:junit4] 2> 1497619 T4326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1497624 T4326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526/collection1/lib/README' to classloader
[junit4:junit4] 2> 1497700 T4326 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1497776 T4326 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1497778 T4326 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1497784 T4326 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1498569 T4326 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1498581 T4326 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1498585 T4326 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1498604 T4326 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1498610 T4326 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1498615 T4326 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1498617 T4326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1498617 T4326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1498617 T4326 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1498619 T4326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1498619 T4326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1498619 T4326 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1498620 T4326 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371455078526\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty2\
[junit4:junit4] 2> 1498621 T4326 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1498621 T4326 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1498622 T4326 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2
[junit4:junit4] 2> 1498623 T4326 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty2\index/
[junit4:junit4] 2> 1498624 T4326 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1498625 T4326 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2\index
[junit4:junit4] 2> 1498639 T4326 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1498639 T4326 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1498643 T4326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1498643 T4326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1498644 T4326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1498646 T4326 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1498647 T4326 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1498647 T4326 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1498647 T4326 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1498648 T4326 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1498649 T4326 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1498660 T4326 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1498671 T4326 oass.SolrIndexSearcher.<init> Opening Searcher@1c19699 main
[junit4:junit4] 2> 1498674 T4326 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1498674 T4326 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1498682 T4327 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c19699 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1498684 T4326 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1498685 T4326 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62043/wt_nn/eo collection:collection1 shard:shard2
[junit4:junit4] 2> 1498686 T4326 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1498700 T4326 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1498706 T4326 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1498707 T4326 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1498707 T4326 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62043/wt_nn/eo/collection1/
[junit4:junit4] 2> 1498707 T4326 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1498707 T4326 oasc.SyncStrategy.syncToMe http://127.0.0.1:62043/wt_nn/eo/collection1/ has no replicas
[junit4:junit4] 2> 1498707 T4326 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62043/wt_nn/eo/collection1/
[junit4:junit4] 2> 1498708 T4326 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1499873 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1499908 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1499909 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1499908 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1499908 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1499938 T4326 oasc.ZkController.register We are http://127.0.0.1:62043/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62043/wt_nn/eo/collection1/
[junit4:junit4] 2> 1499938 T4326 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62043/wt_nn/eo
[junit4:junit4] 2> 1499939 T4326 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1499939 T4326 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1499940 T4326 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1499947 T4326 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1499950 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1499951 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1499951 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1500459 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1500466 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62052
[junit4:junit4] 2> 1500468 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1500468 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1500469 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661
[junit4:junit4] 2> 1500470 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661\solr.xml
[junit4:junit4] 2> 1500471 T4267 oasc.CoreContainer.<init> New CoreContainer 21421296
[junit4:junit4] 2> 1500472 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661\'
[junit4:junit4] 2> 1500472 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661\'
[junit4:junit4] 2> 1500601 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1500602 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1500602 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1500603 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1500603 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1500604 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1500604 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1500604 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1500605 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1500605 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1500614 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1500614 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1500615 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1500617 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1500636 T4339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f28158 name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1500637 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1500640 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1500649 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1500654 T4341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11d68d3 name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1500654 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1500666 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1501435 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1501438 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62043_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62043/wt_nn/eo"}
[junit4:junit4] 2> 1501456 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501457 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501458 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501459 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501459 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501675 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62052_wt_nn%2Feo
[junit4:junit4] 2> 1501681 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62052_wt_nn%2Feo
[junit4:junit4] 2> 1501691 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501691 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501691 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501692 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1501696 T4325 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1501697 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1501706 T4296 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1501706 T4289 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1501707 T4341 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1501708 T4309 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1501727 T4342 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1501728 T4342 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1502981 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1502983 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62052_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62052/wt_nn/eo"}
[junit4:junit4] 2> 1502983 T4290 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 1502983 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 1503006 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1503008 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1503009 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1503009 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1503009 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1503732 T4342 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661\collection1
[junit4:junit4] 2> 1503732 T4342 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1503735 T4342 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1503735 T4342 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1503742 T4342 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661\collection1\'
[junit4:junit4] 2> 1503745 T4342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1503746 T4342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661/collection1/lib/README' to classloader
[junit4:junit4] 2> 1503819 T4342 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1503890 T4342 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1503893 T4342 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1503899 T4342 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1504684 T4342 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1504695 T4342 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1504700 T4342 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1504719 T4342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1504723 T4342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1504729 T4342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1504731 T4342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1504731 T4342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1504731 T4342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1504734 T4342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1504734 T4342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1504734 T4342 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1504735 T4342 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371455084661\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty3\
[junit4:junit4] 2> 1504735 T4342 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1504735 T4342 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1504736 T4342 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty3
[junit4:junit4] 2> 1504736 T4342 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty3\index/
[junit4:junit4] 2> 1504738 T4342 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1504738 T4342 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty3\index
[junit4:junit4] 2> 1504754 T4342 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1504755 T4342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1504762 T4342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1504762 T4342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1504764 T4342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1504766 T4342 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1504768 T4342 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1504768 T4342 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1504769 T4342 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1504770 T4342 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1504771 T4342 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1504782 T4342 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1504797 T4342 oass.SolrIndexSearcher.<init> Opening Searcher@1d0e3b2 main
[junit4:junit4] 2> 1504800 T4342 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1504800 T4342 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1504810 T4343 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d0e3b2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1504812 T4342 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1504812 T4342 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62052/wt_nn/eo collection:collection1 shard:shard3
[junit4:junit4] 2> 1504815 T4342 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 1504831 T4342 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1504837 T4342 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1504837 T4342 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1504837 T4342 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62052/wt_nn/eo/collection1/
[junit4:junit4] 2> 1504837 T4342 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1504839 T4342 oasc.SyncStrategy.syncToMe http://127.0.0.1:62052/wt_nn/eo/collection1/ has no replicas
[junit4:junit4] 2> 1504839 T4342 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62052/wt_nn/eo/collection1/
[junit4:junit4] 2> 1504839 T4342 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 1506033 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1506074 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1506076 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1506077 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1506074 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1506077 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1506121 T4342 oasc.ZkController.register We are http://127.0.0.1:62052/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62052/wt_nn/eo/collection1/
[junit4:junit4] 2> 1506121 T4342 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62052/wt_nn/eo
[junit4:junit4] 2> 1506121 T4342 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1506121 T4342 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1506121 T4342 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1506127 T4342 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1506128 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1506129 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1506129 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1506593 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1506599 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62061
[junit4:junit4] 2> 1506599 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1506601 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1506601 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838
[junit4:junit4] 2> 1506601 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838\solr.xml
[junit4:junit4] 2> 1506602 T4267 oasc.CoreContainer.<init> New CoreContainer 6036434
[junit4:junit4] 2> 1506602 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838\'
[junit4:junit4] 2> 1506603 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838\'
[junit4:junit4] 2> 1506716 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1506716 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1506717 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1506717 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1506718 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1506718 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1506718 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1506719 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1506719 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1506720 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1506727 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1506728 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1506728 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1506730 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1506746 T4355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ff2071 name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1506747 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1506751 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1506752 T4269 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f51178f5b000b, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1506763 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1506769 T4357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11df25f name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1506770 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1506786 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1507604 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1507606 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62052_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62052/wt_nn/eo"}
[junit4:junit4] 2> 1507625 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507625 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507627 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507627 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507628 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507628 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507795 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62061_wt_nn%2Feo
[junit4:junit4] 2> 1507801 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62061_wt_nn%2Feo
[junit4:junit4] 2> 1507810 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507810 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507812 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507811 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1507816 T4357 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1507816 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1507818 T4325 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1507819 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1507826 T4296 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1507826 T4289 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1507827 T4309 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1507828 T4341 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1507838 T4358 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1507838 T4358 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1509152 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1509154 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62061_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62061/wt_nn/eo"}
[junit4:junit4] 2> 1509154 T4290 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 1509155 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1509178 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1509179 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1509182 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1509182 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1509182 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1509182 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1509841 T4358 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838\collection1
[junit4:junit4] 2> 1509841 T4358 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1509844 T4358 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1509844 T4358 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1509849 T4358 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838\collection1\'
[junit4:junit4] 2> 1509854 T4358 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1509856 T4358 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838/collection1/lib/README' to classloader
[junit4:junit4] 2> 1509930 T4358 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1510000 T4358 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1510002 T4358 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1510008 T4358 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1510783 T4358 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1510794 T4358 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1510798 T4358 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1510818 T4358 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1510823 T4358 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1510828 T4358 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1510830 T4358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1510831 T4358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1510831 T4358 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1510833 T4358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1510833 T4358 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1510833 T4358 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1510834 T4358 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371455090838\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty4\
[junit4:junit4] 2> 1510834 T4358 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1510834 T4358 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1510835 T4358 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4
[junit4:junit4] 2> 1510837 T4358 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty4\index/
[junit4:junit4] 2> 1510838 T4358 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1510839 T4358 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index
[junit4:junit4] 2> 1510852 T4358 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1510852 T4358 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1510856 T4358 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1510856 T4358 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1510857 T4358 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1510858 T4358 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1510859 T4358 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1510859 T4358 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1510859 T4358 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1510861 T4358 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1510861 T4358 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1510873 T4358 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1510885 T4358 oass.SolrIndexSearcher.<init> Opening Searcher@1b2f3a7 main
[junit4:junit4] 2> 1510888 T4358 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1510888 T4358 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1510896 T4359 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b2f3a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1510898 T4358 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1510898 T4358 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62061/wt_nn/eo collection:collection1 shard:shard1
[junit4:junit4] 2> 1510905 T4358 oasc.ZkController.register We are http://127.0.0.1:62061/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62034/wt_nn/eo/collection1/
[junit4:junit4] 2> 1510906 T4358 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62061/wt_nn/eo
[junit4:junit4] 2> 1510906 T4358 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1510906 T4358 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1127 name=collection1 org.apache.solr.core.SolrCore@76a5ef url=http://127.0.0.1:62061/wt_nn/eo/collection1 node=127.0.0.1:62061_wt_nn%2Feo C1127_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:62061_wt_nn%2Feo, base_url=http://127.0.0.1:62061/wt_nn/eo}
[junit4:junit4] 2> 1510907 T4360 C1127 P62061 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1510907 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1510908 T4360 C1127 P62061 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1510908 T4360 C1127 P62061 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1510908 T4358 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1510913 T4360 C1127 P62061 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1510914 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1510914 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1510915 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1510927 T4303 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1511411 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1511418 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62071
[junit4:junit4] 2> 1511419 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1511419 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1511420 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612
[junit4:junit4] 2> 1511420 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612\solr.xml
[junit4:junit4] 2> 1511421 T4267 oasc.CoreContainer.<init> New CoreContainer 28122008
[junit4:junit4] 2> 1511421 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612\'
[junit4:junit4] 2> 1511422 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612\'
[junit4:junit4] 2> 1511547 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1511548 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1511548 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1511548 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1511548 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1511549 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1511549 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1511549 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1511551 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1511551 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1511559 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1511560 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1511561 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1511563 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1511586 T4372 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1687cc0 name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1511588 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1511591 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1511601 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1511608 T4374 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18eca9d name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1511609 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1511627 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1512207 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1512209 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62061_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62061/wt_nn/eo"}
[junit4:junit4] 2> 1512234 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512235 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512240 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512235 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512235 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512236 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512237 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512637 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62071_wt_nn%2Feo
[junit4:junit4] 2> 1512643 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62071_wt_nn%2Feo
[junit4:junit4] 2> 1512652 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512655 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512656 T4374 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512656 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1512658 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512658 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1512665 T4325 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512665 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1512667 T4357 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512667 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1512672 T4289 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512673 T4296 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512675 T4309 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512675 T4341 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 1512685 T4375 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1512685 T4375 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1512927 T4303 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1512928 T4303 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:62061_wt_nn%252Feo&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1513761 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1513764 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"6",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62071_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62071/wt_nn/eo"}
[junit4:junit4] 2> 1513764 T4290 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 1513765 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1513790 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1513791 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1513791 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1513792 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1513793 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1513794 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1513793 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1514688 T4375 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612\collection1
[junit4:junit4] 2> 1514689 T4375 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1514691 T4375 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1514691 T4375 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1514698 T4375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612\collection1\'
[junit4:junit4] 2> 1514701 T4375 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1514703 T4375 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612/collection1/lib/README' to classloader
[junit4:junit4] 2> 1514767 T4375 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1514837 T4375 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1514840 T4375 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1514846 T4375 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> C1127_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:62061_wt_nn%2Feo, base_url=http://127.0.0.1:62061/wt_nn/eo}
[junit4:junit4] 2> 1514931 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:62034/wt_nn/eo/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1514931 T4360 C1127 P62061 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:62061/wt_nn/eo START replicas=[http://127.0.0.1:62034/wt_nn/eo/collection1/] nUpdates=100
[junit4:junit4] 2> 1514932 T4360 C1127 P62061 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1514932 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1514932 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1514932 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1514932 T4360 C1127 P62061 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1514933 T4360 C1127 P62061 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:62034/wt_nn/eo/collection1/. core=collection1
[junit4:junit4] 2> 1514933 T4360 C1127 P62061 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1128 name=collection1 org.apache.solr.core.SolrCore@107605a url=http://127.0.0.1:62034/wt_nn/eo/collection1 node=127.0.0.1:62034_wt_nn%2Feo C1128_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:62034_wt_nn%2Feo, base_url=http://127.0.0.1:62034/wt_nn/eo, leader=true}
[junit4:junit4] 2> 1514948 T4300 C1128 P62034 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1514949 T4302 C1128 P62034 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1514957 T4300 C1128 P62034 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1514958 T4300 C1128 P62034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1514969 T4300 C1128 P62034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 1514969 T4300 C1128 P62034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1514972 T4300 C1128 P62034 oass.SolrIndexSearcher.<init> Opening Searcher@1ebd27d realtime
[junit4:junit4] 2> 1514973 T4300 C1128 P62034 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1514973 T4300 C1128 P62034 oasup.LogUpdateProcessor.finish [collection1] webapp=/wt_nn/eo path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 1514974 T4360 C1127 P62061 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1514974 T4360 C1127 P62061 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1514978 T4301 C1128 P62034 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1514979 T4301 C1128 P62034 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1514979 T4360 C1127 P62061 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1514979 T4360 C1127 P62061 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1514979 T4360 C1127 P62061 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1514990 T4304 C1128 P62034 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=7
[junit4:junit4] 2> 1514991 T4360 C1127 P62061 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1514992 T4360 C1127 P62061 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index.20130617014459679
[junit4:junit4] 2> 1514993 T4360 C1127 P62061 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index.20130617014459679 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f68790 fullCopy=false
[junit4:junit4] 2> 1514998 T4305 C1128 P62034 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1514999 T4360 C1127 P62061 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1515007 T4360 C1127 P62061 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1515007 T4360 C1127 P62061 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1515011 T4360 C1127 P62061 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 1515013 T4360 C1127 P62061 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1515013 T4360 C1127 P62061 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1515015 T4360 C1127 P62061 oass.SolrIndexSearcher.<init> Opening Searcher@1645be4 main
[junit4:junit4] 2> 1515016 T4359 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1645be4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1515018 T4360 C1127 P62061 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index.20130617014459679 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index.20130617014459679;done=true>>]
[junit4:junit4] 2> 1515018 T4360 C1127 P62061 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index.20130617014459679
[junit4:junit4] 2> 1515018 T4360 C1127 P62061 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty4\index.20130617014459679
[junit4:junit4] 2> 1515019 T4360 C1127 P62061 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1515019 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1515019 T4360 C1127 P62061 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1515019 T4360 C1127 P62061 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1515023 T4360 C1127 P62061 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1515310 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1515311 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62061_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62061/wt_nn/eo"}
[junit4:junit4] 2> 1515324 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515324 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515325 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515325 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515325 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515325 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515326 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1515644 T4375 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1515657 T4375 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1515662 T4375 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1515685 T4375 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1515699 T4375 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1515703 T4375 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1515706 T4375 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1515707 T4375 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1515707 T4375 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1515709 T4375 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1515709 T4375 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1515709 T4375 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1515710 T4375 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371455095612\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty5\
[junit4:junit4] 2> 1515710 T4375 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1515710 T4375 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1515711 T4375 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5
[junit4:junit4] 2> 1515712 T4375 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty5\index/
[junit4:junit4] 2> 1515713 T4375 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1515714 T4375 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index
[junit4:junit4] 2> 1515722 T4375 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1515723 T4375 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1515728 T4375 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1515729 T4375 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1515730 T4375 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1515732 T4375 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1515734 T4375 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1515734 T4375 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1515741 T4375 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1515742 T4375 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1515742 T4375 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1515751 T4375 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1515763 T4375 oass.SolrIndexSearcher.<init> Opening Searcher@159aa61 main
[junit4:junit4] 2> 1515765 T4375 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1515765 T4375 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1515771 T4378 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@159aa61 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1515773 T4375 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1515773 T4375 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62071/wt_nn/eo collection:collection1 shard:shard2
[junit4:junit4] 2> 1515780 T4375 oasc.ZkController.register We are http://127.0.0.1:62071/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62043/wt_nn/eo/collection1/
[junit4:junit4] 2> 1515781 T4375 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62071/wt_nn/eo
[junit4:junit4] 2> 1515781 T4375 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1515781 T4375 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1129 name=collection1 org.apache.solr.core.SolrCore@1fd5f1d url=http://127.0.0.1:62071/wt_nn/eo/collection1 node=127.0.0.1:62071_wt_nn%2Feo C1129_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:62071_wt_nn%2Feo, base_url=http://127.0.0.1:62071/wt_nn/eo}
[junit4:junit4] 2> 1515782 T4379 C1129 P62071 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1515782 T4379 C1129 P62071 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1515783 T4379 C1129 P62071 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1515783 T4379 C1129 P62071 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1515783 T4375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1515785 T4379 C1129 P62071 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1515787 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1515787 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1515787 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1515795 T4321 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 6, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1516282 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1516287 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62084
[junit4:junit4] 2> 1516289 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1516289 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1516289 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481
[junit4:junit4] 2> 1516290 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481\solr.xml
[junit4:junit4] 2> 1516290 T4267 oasc.CoreContainer.<init> New CoreContainer 11277653
[junit4:junit4] 2> 1516291 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481\'
[junit4:junit4] 2> 1516291 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481\'
[junit4:junit4] 2> 1516421 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1516421 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1516421 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1516422 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1516422 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1516423 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1516423 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1516424 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1516425 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1516425 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1516433 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1516434 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1516435 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1516437 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1516459 T4391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@194db19 name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1516460 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1516465 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1516474 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1516478 T4393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1128da3 name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1516479 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1516492 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1516842 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1516845 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"6",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62071_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62071/wt_nn/eo"}
[junit4:junit4] 2> 1516866 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516867 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516867 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516868 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516867 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516868 T4393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516867 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1516868 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1517498 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62084_wt_nn%2Feo
[junit4:junit4] 2> 1517504 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62084_wt_nn%2Feo
[junit4:junit4] 2> 1517512 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1517515 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1517515 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1517515 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 1517520 T4374 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517520 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1517523 T4393 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517523 T4393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1517524 T4325 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517525 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1517526 T4357 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517526 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1517535 T4296 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517537 T4341 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517537 T4289 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517537 T4309 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 1517548 T4394 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1517548 T4394 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1517795 T4321 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 6, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1517796 T4321 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=6&state=recovering&nodeName=127.0.0.1:62071_wt_nn%252Feo&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001
[junit4:junit4] 2> 1518398 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1518400 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"7",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62084_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62084/wt_nn/eo"}
[junit4:junit4] 2> 1518401 T4290 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 1518401 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 1518427 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518429 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518430 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518431 T4393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518431 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518433 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518428 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518429 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1518550 T4394 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481\collection1
[junit4:junit4] 2> 1518550 T4394 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1518553 T4394 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1518553 T4394 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1518559 T4394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481\collection1\'
[junit4:junit4] 2> 1518563 T4394 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1518565 T4394 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481/collection1/lib/README' to classloader
[junit4:junit4] 2> 1518624 T4394 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1518692 T4394 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1518695 T4394 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1518700 T4394 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1519451 T4394 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1519462 T4394 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1519467 T4394 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1519492 T4394 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1519497 T4394 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1519502 T4394 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1519504 T4394 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1519504 T4394 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1519504 T4394 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1519506 T4394 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1519506 T4394 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1519507 T4394 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1519507 T4394 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371455100481\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty6\
[junit4:junit4] 2> 1519507 T4394 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b9459
[junit4:junit4] 2> 1519507 T4394 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1519509 T4394 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty6
[junit4:junit4] 2> 1519510 T4394 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935/jetty6\index/
[junit4:junit4] 2> 1519512 T4394 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty6\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1519512 T4394 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty6\index
[junit4:junit4] 2> 1519527 T4394 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty6\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1519527 T4394 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1519532 T4394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1519532 T4394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1519533 T4394 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1519533 T4394 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1519534 T4394 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1519535 T4394 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1519535 T4394 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1519536 T4394 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1519537 T4394 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1519551 T4394 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1519562 T4394 oass.SolrIndexSearcher.<init> Opening Searcher@14d7e0d main
[junit4:junit4] 2> 1519565 T4394 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1519565 T4394 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1519573 T4395 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14d7e0d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1519575 T4394 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1519575 T4394 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62084/wt_nn/eo collection:collection1 shard:shard3
[junit4:junit4] 2> 1519582 T4394 oasc.ZkController.register We are http://127.0.0.1:62084/wt_nn/eo/collection1/ and leader is http://127.0.0.1:62052/wt_nn/eo/collection1/
[junit4:junit4] 2> 1519582 T4394 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62084/wt_nn/eo
[junit4:junit4] 2> 1519582 T4394 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1519582 T4394 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1130 name=collection1 org.apache.solr.core.SolrCore@98141 url=http://127.0.0.1:62084/wt_nn/eo/collection1 node=127.0.0.1:62084_wt_nn%2Feo C1130_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:62084_wt_nn%2Feo, base_url=http://127.0.0.1:62084/wt_nn/eo}
[junit4:junit4] 2> 1519583 T4396 C1130 P62084 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1519583 T4396 C1130 P62084 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1519584 T4394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1519584 T4396 C1130 P62084 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1519584 T4396 C1130 P62084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1519586 T4267 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 1519587 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1519587 T4396 C1130 P62084 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1519587 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1519598 T4337 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 7, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> ASYNC NEW_CORE C1131 name=collection1 org.apache.solr.core.SolrCore@1fd5f1d url=http://127.0.0.1:62071/wt_nn/eo/collection1 node=127.0.0.1:62071_wt_nn%2Feo C1131_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:62071_wt_nn%2Feo, base_url=http://127.0.0.1:62071/wt_nn/eo}
[junit4:junit4] 2> 1519797 T4379 C1131 P62071 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:62043/wt_nn/eo/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1519797 T4379 C1131 P62071 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:62071/wt_nn/eo START replicas=[http://127.0.0.1:62043/wt_nn/eo/collection1/] nUpdates=100
[junit4:junit4] 2> 1519798 T4379 C1131 P62071 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1519799 T4379 C1131 P62071 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1519799 T4379 C1131 P62071 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1519800 T4379 C1131 P62071 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1519800 T4379 C1131 P62071 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1519800 T4379 C1131 P62071 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:62043/wt_nn/eo/collection1/. core=collection1
[junit4:junit4] 2> 1519800 T4379 C1131 P62071 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1132 name=collection1 org.apache.solr.core.SolrCore@780a4b url=http://127.0.0.1:62043/wt_nn/eo/collection1 node=127.0.0.1:62043_wt_nn%2Feo C1132_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:62043_wt_nn%2Feo, base_url=http://127.0.0.1:62043/wt_nn/eo, leader=true}
[junit4:junit4] 2> 1519819 T4321 C1132 P62043 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1519823 T4320 C1132 P62043 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1519829 T4320 C1132 P62043 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 1519831 T4320 C1132 P62043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1519843 T4320 C1132 P62043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 1519843 T4320 C1132 P62043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1519846 T4320 C1132 P62043 oass.SolrIndexSearcher.<init> Opening Searcher@6338a5 realtime
[junit4:junit4] 2> 1519847 T4320 C1132 P62043 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1519848 T4320 C1132 P62043 oasup.LogUpdateProcessor.finish [collection1] webapp=/wt_nn/eo path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 1519849 T4379 C1131 P62071 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1519849 T4379 C1131 P62071 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1519852 T4316 C1132 P62043 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1519853 T4316 C1132 P62043 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1519853 T4379 C1131 P62071 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1519853 T4379 C1131 P62071 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1519853 T4379 C1131 P62071 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1519856 T4317 C1132 P62043 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 1519857 T4379 C1131 P62071 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1519859 T4379 C1131 P62071 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index.20130617014504545
[junit4:junit4] 2> 1519862 T4379 C1131 P62071 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index.20130617014504545 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12e9cc6 fullCopy=false
[junit4:junit4] 2> 1519865 T4318 C1132 P62043 oasc.SolrCore.execute [collection1] webapp=/wt_nn/eo path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1519867 T4379 C1131 P62071 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1519872 T4379 C1131 P62071 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1519872 T4379 C1131 P62071 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1519878 T4379 C1131 P62071 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 1519879 T4379 C1131 P62071 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1519879 T4379 C1131 P62071 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1519882 T4379 C1131 P62071 oass.SolrIndexSearcher.<init> Opening Searcher@e9b88 main
[junit4:junit4] 2> 1519883 T4378 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e9b88 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1519884 T4379 C1131 P62071 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index.20130617014504545 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index.20130617014504545;done=true>>]
[junit4:junit4] 2> 1519884 T4379 C1131 P62071 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index.20130617014504545
[junit4:junit4] 2> 1519884 T4379 C1131 P62071 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371455065935\jetty5\index.20130617014504545
[junit4:junit4] 2> 1519885 T4379 C1131 P62071 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1519886 T4379 C1131 P62071 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1519886 T4379 C1131 P62071 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1519886 T4379 C1131 P62071 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1519890 T4379 C1131 P62071 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1519954 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1519956 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"7",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62084_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62084/wt_nn/eo"}
[junit4:junit4] 2> 1519967 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"6",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62071_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62071/wt_nn/eo"}
[junit4:junit4] 2> 1519980 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519981 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519982 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519982 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519982 T4393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519983 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519983 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1519983 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1520034 T4267 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1520038 T4267 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62097
[junit4:junit4] 2> 1520039 T4267 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1520040 T4267 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1520040 T4267 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371455104287
[junit4:junit4] 2> 1520041 T4267 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371455104287\solr.xml
[junit4:junit4] 2> 1520041 T4267 oasc.CoreContainer.<init> New CoreContainer 6150874
[junit4:junit4] 2> 1520042 T4267 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371455104287\'
[junit4:junit4] 2> 1520042 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371455104287\'
[junit4:junit4] 2> 1520165 T4267 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1520165 T4267 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1520166 T4267 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1520166 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1520166 T4267 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1520167 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1520167 T4267 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1520167 T4267 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1520167 T4267 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1520168 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1520178 T4267 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1520178 T4267 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62015/solr
[junit4:junit4] 2> 1520179 T4267 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1520182 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1520187 T4410 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10ccd70 name:ZooKeeperConnection Watcher:127.0.0.1:62015 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1520188 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1520192 T4267 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1520192 T4269 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f51178f5b0011, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1520198 T4267 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1520201 T4412 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@197f6f3 name:ZooKeeperConnection Watcher:127.0.0.1:62015/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1520201 T4267 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1520211 T4267 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1520599 T4337 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 7, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1520600 T4337 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=7&state=recovering&nodeName=127.0.0.1:62084_wt_nn%252Feo&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1521217 T4267 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62097_wt_nn%2Feo
[junit4:junit4] 2> 1521231 T4267 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62097_wt_nn%2Feo
[junit4:junit4] 2> 1521240 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1521241 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1521242 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1521242 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 1521250 T4374 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521250 T4374 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521253 T4325 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521253 T4325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521255 T4393 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521256 T4393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521257 T4357 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521258 T4357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521262 T4412 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521263 T4289 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521265 T4296 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521265 T4341 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521266 T4309 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 1521278 T4413 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1521279 T4413 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1521503 T4290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1521505 T4290 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"8",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62097_wt_nn%2Feo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62097/wt_nn/eo"}
[junit4:junit4] 2> 1521505 T4290 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 1521507 T4290 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1521525 T4289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521527 T4296 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521528 T4341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521530 T4309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 1521530 T4393 oascc.ZkStateReader$2.process A cluster st
[...truncated too long message...]
ava.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 70) Thread[id=4605, name=Thread-1933-SendThread(127.0.0.1:62015), state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4:junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] 2> 71) Thread[id=4347, name=qtp27239460-4347 Acceptor0 SelectChannelConnector@127.0.0.1:62061, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=SimpleText), text=PostingsFormat(name=Lucene41WithOrds), _version_=PostingsFormat(name=SimpleText), rnd_b=PostingsFormat(name=NestedPulsing), intDefault=PostingsFormat(name=SimpleText), timestamp=PostingsFormat(name=SimpleText), id=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=SimpleText), range_facet_sl=PostingsFormat(name=Lucene41WithOrds), range_facet_si=Lucene41(blocksize=128), other_tl1=PostingsFormat(name=SimpleText), multiDefault=Lucene41(blocksize=128), a_si=Lucene41(blocksize=128)}, docValues:{}, sim=DefaultSimilarity, locale=lv_LV, timezone=America/Swift_Current
[junit4:junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_21 (32-bit)/cpus=2,threads=192,free=184193728,total=465567744
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestMergePolicyConfig, TestFieldTypeResource, DocValuesTest, TestDFRSimilarityFactory, TestReversedWildcardFilterFactory, BadCopyFieldTest, DocValuesMultiTest, TestDistributedSearch, TestSerializedLuceneMatchVersion, SampleTest, TestRecovery, ChaosMonkeyNothingIsSafeTest, TestSort, TestRandomDVFaceting, SolrRequestParserTest, QueryResultKeyTest, TestWriterPerf, RequestHandlersTest, PreAnalyzedUpdateProcessorTest, SyncSliceTest, SolrCoreCheckLockOnStartupTest, ZkSolrClientTest, ReturnFieldsTest, SchemaVersionSpecificBehaviorTest, JsonLoaderTest, SignatureUpdateProcessorFactoryTest, FieldAnalysisRequestHandlerTest, SortByFunctionTest, ConvertedLegacyTest, TestGroupingSearch, TestSolr4Spatial, TestRealTimeGet, FileBasedSpellCheckerTest, CopyFieldTest, FullSolrCloudDistribCmdsTest, TestUtils, AlternateDirectoryTest, TestIndexingPerformance, TestSolrXmlPersistence, BasicDistributedZk2Test, TestManagedSchema, WordBreakSolrSpellCheckerTest, IndexBasedSpellCheckerTest, TestSolrJ, TestLFUCache, SynonymTokenizerTest, SuggesterFSTTest, TestLuceneMatchVersion, OutputWriterTest, TestMultiCoreConfBootstrap, SpatialFilterTest, TestFieldResource, CircularListTest, TestFastOutputStream, TestSuggestSpellingConverter, QueryParsingTest, TestJmxIntegration, TestSweetSpotSimilarityFactory, ZkCLITest, RequiredFieldsTest, TestCollationKeyRangeQueries, UUIDFieldTest, TestRangeQuery, TestPropInjectDefaults, RecoveryZkTest, PolyFieldTest, UniqFieldsUpdateProcessorFactoryTest, TestReplicationHandler, SOLR749Test, TestSolrDeletionPolicy2, TermVectorComponentTest, SpellCheckCollatorTest, TestBadConfig, XsltUpdateRequestHandlerTest, DocumentBuilderTest, SliceStateTest, CoreAdminHandlerTest, TestCharFilters, PeerSyncTest, DocumentAnalysisRequestHandlerTest, PreAnalyzedFieldTest, TimeZoneUtilsTest, LeaderElectionTest, CollectionsAPIDistributedZkTest, TestCodecSupport, TestCoreContainer, TestReloadAndDeleteDocs, SpellPossibilityIteratorTest, IndexReaderFactoryTest, TestDistributedGrouping, TestAtomicUpdateErrorCases, LeaderElectionIntegrationTest, TestPHPSerializedResponseWriter, TestZkChroot, TestSchemaSimilarityResource, TestValueSourceCache, CurrencyFieldXmlFileTest, RAMDirectoryFactoryTest, UpdateParamsTest, AliasIntegrationTest, TestCopyFieldCollectionResource, SearchHandlerTest, TestIBSimilarityFactory, ShardRoutingCustomTest, DisMaxRequestHandlerTest, StandardRequestHandlerTest, BasicDistributedZkTest, TestSearchPerf, DistributedQueryElevationComponentTest, TestNumberUtils, StatsComponentTest, DateFieldTest, TestSolrQueryParserResource, MultiTermTest, URLClassifyProcessorTest, HighlighterTest, TestCloudManagedSchema, DistributedTermsComponentTest, TestSchemaResource, TestRemoteStreaming, TestPostingsSolrHighlighter, TestSystemIdResolver, TestFastWriter, PingRequestHandlerTest, DirectSolrSpellCheckerTest, TestDocumentBuilder, TestFuzzyAnalyzedSuggestions, ClusterStateTest, AnalysisAfterCoreReloadTest, AutoCommitTest, SpellingQueryConverterTest, SliceStateUpdateTest, NotRequiredUniqueKeyTest, TestLMDirichletSimilarityFactory, TestOmitPositions, QueryEqualityTest, PathHierarchyTokenizerFactoryTest, JSONWriterTest, CachingDirectoryFactoryTest, BasicZkTest, OverseerCollectionProcessorTest, ShowFileRequestHandlerTest, TestBM25SimilarityFactory, TestQuerySenderListener, StatelessScriptUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=AED3CB3C28300DDA -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=America/Swift_Current -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([AED3CB3C28300DDA]:0)
[junit4:junit4] Completed in 7420.81s, 1 test, 2 errors <<< FAILURES!
[...truncated 400 lines...]
[junit4:junit4] Suite: org.apache.solr.logging.TestLogWatcher
[junit4:junit4] 2> 9723347 T4653 oaz.ClientCnxn$SendThread.run WARN Session 0x13f51178f5b0028 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 9723591 T4267 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/wt_nn/eo,null}
[junit4:junit4] 2> 9723778 T4549 oaz.ClientCnxn$SendThread.run WARN Session 0x13f51178f5b001e for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 9724082 T1 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 9724091 T1 oasl.TestLogWatcher.testLog4jWatcher WARN This is a test message
[junit4:junit4] 2> 9724167 T4468 oaz.ClientCnxn$SendThread.run WARN Session 0x13f51178f5b0018 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] FAILURE 3.16s | TestLogWatcher.testLog4jWatcher <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: expected:<2> but was:<1>
[junit4:junit4] > at org.apache.solr.logging.TestLogWatcher.testLog4jWatcher(TestLogWatcher.java:63)
[junit4:junit4] Completed in 3.18s, 1 test, 1 failure <<< FAILURES!
[...truncated 53 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1252 tests, 1 suite-level error, 1 error, 1 failure, 565 ignored (2 assumptions)
Total time: 184 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_21) - Build #
2899 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2899/
Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard2 is not consistent. Got 620 from http://127.0.0.1:52427/rme/b/collection1lastClient and got 611 from http://127.0.0.1:52460/rme/b/collection1
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 620 from http://127.0.0.1:52427/rme/b/collection1lastClient and got 611 from http://127.0.0.1:52460/rme/b/collection1
at __randomizedtesting.SeedInfo.seed([F52577DB69AC6D2F:74C3F9C31EF30D13]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9202 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 269897 T662 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /rme/b
[junit4:junit4] 2> 269901 T662 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1371426953239
[junit4:junit4] 2> 269903 T662 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 269904 T663 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 269987 T662 oasc.ZkTestServer.run start zk server on port:52332
[junit4:junit4] 2> 269990 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 270004 T669 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18ebd7f name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 270004 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 270005 T662 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 270012 T664 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4f6a98200000, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 270013 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 270018 T671 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dd42c1 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 270019 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 270019 T662 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 270025 T662 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 270030 T662 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 270035 T662 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 270040 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 270040 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 270049 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 270050 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 270056 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 270056 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 270061 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 270062 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 270067 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 270068 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 270073 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 270073 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 270078 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 270079 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 270085 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 270085 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 270100 T662 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 270101 T662 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 270107 T664 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4f6a98200001, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 270598 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 270606 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52339
[junit4:junit4] 2> 270606 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 270607 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 270607 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444
[junit4:junit4] 2> 270608 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444\solr.xml
[junit4:junit4] 2> 270609 T662 oasc.CoreContainer.<init> New CoreContainer 23488739
[junit4:junit4] 2> 270609 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444\'
[junit4:junit4] 2> 270610 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444\'
[junit4:junit4] 2> 270733 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 270734 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 270735 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 270735 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 270735 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 270736 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 270737 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 270737 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 270737 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 270738 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 270752 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 270753 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 270753 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 270756 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 270772 T682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c553ca name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 270773 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 270777 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 270788 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 270791 T684 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@585a57 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 270792 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 270795 T662 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 270806 T662 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 270812 T662 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 270816 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52339_rme%2Fb
[junit4:junit4] 2> 270819 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52339_rme%2Fb
[junit4:junit4] 2> 270827 T662 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 270840 T662 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 270845 T662 oasc.Overseer.start Overseer (id=89877836808060931-127.0.0.1:52339_rme%2Fb-n_0000000000) starting
[junit4:junit4] 2> 270853 T662 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 270861 T686 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 270863 T662 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 270868 T662 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 270871 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 270876 T685 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 270882 T687 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 270882 T687 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 272116 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 272117 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52339_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52339/rme/b"}
[junit4:junit4] 2> 272118 T685 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 272118 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 272131 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 272529 T687 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444\collection1
[junit4:junit4] 2> 272529 T687 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 272531 T687 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 272531 T687 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 272533 T687 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444\collection1\'
[junit4:junit4] 2> 272536 T687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 272537 T687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444/collection1/lib/README' to classloader
[junit4:junit4] 2> 272615 T687 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 272730 T687 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 272733 T687 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 272739 T687 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 273429 T687 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 273441 T687 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 273470 T687 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 273491 T687 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 273496 T687 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 273502 T687 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 273503 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 273504 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 273504 T687 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 273505 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 273506 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 273507 T687 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 273535 T687 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371426953444\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/control/data\
[junit4:junit4] 2> 273535 T687 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 273535 T687 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 273536 T687 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\control\data
[junit4:junit4] 2> 273537 T687 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/control/data\index/
[junit4:junit4] 2> 273538 T687 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 273538 T687 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\control\data\index
[junit4:junit4] 2> 273549 T687 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 273549 T687 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 273551 T687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 273551 T687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 273553 T687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 273553 T687 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 273554 T687 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 273554 T687 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 273554 T687 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 273555 T687 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 273555 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 273564 T687 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 273575 T687 oass.SolrIndexSearcher.<init> Opening Searcher@c75077 main
[junit4:junit4] 2> 273576 T687 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 273576 T687 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 273583 T687 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 273583 T687 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52339/rme/b collection:control_collection shard:shard1
[junit4:junit4] 2> 273584 T688 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c75077 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 273584 T687 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 273600 T687 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 273605 T687 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 273605 T687 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 273606 T687 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52339/rme/b/collection1/
[junit4:junit4] 2> 273606 T687 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 273606 T687 oasc.SyncStrategy.syncToMe http://127.0.0.1:52339/rme/b/collection1/ has no replicas
[junit4:junit4] 2> 273606 T687 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52339/rme/b/collection1/
[junit4:junit4] 2> 273606 T687 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 274608 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 274625 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 274664 T687 oasc.ZkController.register We are http://127.0.0.1:52339/rme/b/collection1/ and leader is http://127.0.0.1:52339/rme/b/collection1/
[junit4:junit4] 2> 274664 T687 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52339/rme/b
[junit4:junit4] 2> 274664 T687 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 274664 T687 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 274664 T687 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 274668 T687 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 274669 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 274669 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 274670 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 274678 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 274681 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 274684 T691 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169126d name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 274684 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 274687 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 274691 T662 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 275167 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 275172 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52351
[junit4:junit4] 2> 275173 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 275173 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 275175 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028
[junit4:junit4] 2> 275175 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028\solr.xml
[junit4:junit4] 2> 275176 T662 oasc.CoreContainer.<init> New CoreContainer 3262499
[junit4:junit4] 2> 275177 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028\'
[junit4:junit4] 2> 275177 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028\'
[junit4:junit4] 2> 275330 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 275332 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 275332 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 275332 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 275332 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 275333 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 275334 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 275334 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 275335 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 275336 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 275347 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 275348 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 275348 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 275351 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 275362 T702 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a883f7 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 275363 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 275368 T664 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4f6a98200005, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 275368 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 275379 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 275383 T704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14d736 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 275384 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 275393 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 275868 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 275869 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52339_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52339_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52339/rme/b"}
[junit4:junit4] 2> 275880 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 275880 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 275880 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 276220 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52351_rme%2Fb
[junit4:junit4] 2> 276223 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52351_rme%2Fb
[junit4:junit4] 2> 276227 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 276227 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 276227 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 276231 T691 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 276232 T684 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 276232 T704 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 276240 T705 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 276240 T705 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 277181 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 277183 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52351_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52351/rme/b"}
[junit4:junit4] 2> 277183 T685 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 277183 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 277198 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 277198 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 277198 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 278022 T705 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028\collection1
[junit4:junit4] 2> 278022 T705 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 278023 T705 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 278023 T705 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 278025 T705 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028\collection1\'
[junit4:junit4] 2> 278028 T705 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 278028 T705 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028/collection1/lib/README' to classloader
[junit4:junit4] 2> 278084 T705 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 278148 T705 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 278151 T705 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 278156 T705 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 278905 T705 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 278916 T705 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 278920 T705 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 278939 T705 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 278944 T705 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 278949 T705 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 278952 T705 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 278952 T705 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 278952 T705 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 278954 T705 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 278954 T705 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 278955 T705 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 278955 T705 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371426958028\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty1\
[junit4:junit4] 2> 278955 T705 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 278955 T705 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 278955 T705 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1
[junit4:junit4] 2> 278956 T705 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty1\index/
[junit4:junit4] 2> 278957 T705 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 278958 T705 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1\index
[junit4:junit4] 2> 278967 T705 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 278967 T705 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 278970 T705 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 278970 T705 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 278971 T705 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 278972 T705 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 278972 T705 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 278972 T705 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 278973 T705 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 278974 T705 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 278974 T705 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 278985 T705 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 278993 T705 oass.SolrIndexSearcher.<init> Opening Searcher@1eb7ab6 main
[junit4:junit4] 2> 278996 T705 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 278996 T705 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 279003 T706 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1eb7ab6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 279005 T705 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 279005 T705 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52351/rme/b collection:collection1 shard:shard1
[junit4:junit4] 2> 279007 T705 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 279022 T705 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 279027 T705 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 279027 T705 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 279027 T705 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52351/rme/b/collection1/
[junit4:junit4] 2> 279027 T705 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 279027 T705 oasc.SyncStrategy.syncToMe http://127.0.0.1:52351/rme/b/collection1/ has no replicas
[junit4:junit4] 2> 279028 T705 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52351/rme/b/collection1/
[junit4:junit4] 2> 279028 T705 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 279924 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 279941 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 279941 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 279941 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 279958 T705 oasc.ZkController.register We are http://127.0.0.1:52351/rme/b/collection1/ and leader is http://127.0.0.1:52351/rme/b/collection1/
[junit4:junit4] 2> 279958 T705 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52351/rme/b
[junit4:junit4] 2> 279958 T705 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 279958 T705 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 279958 T705 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 279962 T705 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 279964 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 279964 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 279965 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 280424 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 280430 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52360
[junit4:junit4] 2> 280431 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 280431 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 280431 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310
[junit4:junit4] 2> 280431 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310\solr.xml
[junit4:junit4] 2> 280433 T662 oasc.CoreContainer.<init> New CoreContainer 6614324
[junit4:junit4] 2> 280433 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310\'
[junit4:junit4] 2> 280434 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310\'
[junit4:junit4] 2> 280550 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 280551 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 280552 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 280553 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 280553 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 280554 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 280554 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 280555 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 280556 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 280556 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 280568 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 280570 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 280570 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 280573 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 280588 T718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@196ec68 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 280589 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 280595 T664 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4f6a98200007, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 280595 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 280606 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 280610 T720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@209a98 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 280611 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 280620 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 281309 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 281311 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52351_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52351_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52351/rme/b"}
[junit4:junit4] 2> 281331 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281331 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281332 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281331 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281531 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52360_rme%2Fb
[junit4:junit4] 2> 281533 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52360_rme%2Fb
[junit4:junit4] 2> 281539 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281539 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281539 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281539 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 281547 T704 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 281548 T691 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 281548 T720 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 281548 T684 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 281557 T721 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 281557 T721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 282700 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 282701 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52360_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52360/rme/b"}
[junit4:junit4] 2> 282701 T685 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 282701 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 282717 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 282718 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 282718 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 282717 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 283369 T721 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310\collection1
[junit4:junit4] 2> 283369 T721 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 283370 T721 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 283370 T721 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 283372 T721 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310\collection1\'
[junit4:junit4] 2> 283374 T721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 283375 T721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310/collection1/lib/README' to classloader
[junit4:junit4] 2> 283455 T721 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 283527 T721 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 283530 T721 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 283536 T721 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 284263 T721 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 284276 T721 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 284280 T721 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 284304 T721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 284311 T721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 284319 T721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 284322 T721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 284322 T721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 284323 T721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 284324 T721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 284324 T721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 284325 T721 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 284325 T721 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371426963310\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty2\
[junit4:junit4] 2> 284326 T721 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 284326 T721 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 284328 T721 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2
[junit4:junit4] 2> 284330 T721 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty2\index/
[junit4:junit4] 2> 284331 T721 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 284331 T721 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2\index
[junit4:junit4] 2> 284347 T721 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 284347 T721 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 284352 T721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 284352 T721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 284354 T721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 284354 T721 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 284355 T721 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 284355 T721 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 284355 T721 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 284358 T721 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 284358 T721 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 284375 T721 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 284390 T721 oass.SolrIndexSearcher.<init> Opening Searcher@1d32be2 main
[junit4:junit4] 2> 284393 T721 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 284393 T721 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 284404 T722 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d32be2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 284407 T721 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 284407 T721 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52360/rme/b collection:collection1 shard:shard2
[junit4:junit4] 2> 284409 T721 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 284428 T721 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 284433 T721 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 284433 T721 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 284433 T721 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52360/rme/b/collection1/
[junit4:junit4] 2> 284434 T721 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 284434 T721 oasc.SyncStrategy.syncToMe http://127.0.0.1:52360/rme/b/collection1/ has no replicas
[junit4:junit4] 2> 284434 T721 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52360/rme/b/collection1/
[junit4:junit4] 2> 284434 T721 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 285443 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 285458 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 285458 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 285459 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 285458 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 285501 T721 oasc.ZkController.register We are http://127.0.0.1:52360/rme/b/collection1/ and leader is http://127.0.0.1:52360/rme/b/collection1/
[junit4:junit4] 2> 285501 T721 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52360/rme/b
[junit4:junit4] 2> 285501 T721 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 285501 T721 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 285501 T721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 285518 T721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 285519 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 285519 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 285521 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 285947 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 285953 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52369
[junit4:junit4] 2> 285955 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 285955 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 285955 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865
[junit4:junit4] 2> 285955 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865\solr.xml
[junit4:junit4] 2> 285956 T662 oasc.CoreContainer.<init> New CoreContainer 11366255
[junit4:junit4] 2> 285957 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865\'
[junit4:junit4] 2> 285957 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865\'
[junit4:junit4] 2> 286081 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 286081 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 286082 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 286082 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 286083 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 286083 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 286083 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 286084 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 286084 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 286085 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 286093 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 286094 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 286094 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 286096 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 286112 T734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1970527 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 286114 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 286117 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 286125 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 286129 T736 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@361f7a name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 286129 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 286137 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 286949 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 286951 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52360_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52360_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52360/rme/b"}
[junit4:junit4] 2> 286963 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 286964 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 286964 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 286965 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 286963 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 287137 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52369_rme%2Fb
[junit4:junit4] 2> 287141 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52369_rme%2Fb
[junit4:junit4] 2> 287147 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 287147 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 287148 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 287148 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 287149 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 287156 T684 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 287156 T704 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 287158 T691 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 287160 T720 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 287160 T736 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 287173 T737 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 287173 T737 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 288471 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 288472 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52369_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52369/rme/b"}
[junit4:junit4] 2> 288472 T685 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 288473 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 288500 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 288501 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 288502 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 288502 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 288502 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 289166 T737 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865\collection1
[junit4:junit4] 2> 289166 T737 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 289168 T737 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 289168 T737 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 289170 T737 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865\collection1\'
[junit4:junit4] 2> 289172 T737 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 289172 T737 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865/collection1/lib/README' to classloader
[junit4:junit4] 2> 289239 T737 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 289316 T737 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 289319 T737 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 289327 T737 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 290279 T737 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 290294 T737 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 290300 T737 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 290323 T737 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 290328 T737 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 290334 T737 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 290338 T737 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 290338 T737 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 290338 T737 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 290340 T737 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 290340 T737 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 290341 T737 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 290341 T737 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371426968865\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty3\
[junit4:junit4] 2> 290341 T737 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 290342 T737 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 290342 T737 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty3
[junit4:junit4] 2> 290342 T737 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty3\index/
[junit4:junit4] 2> 290342 T737 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 290342 T737 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty3\index
[junit4:junit4] 2> 290356 T737 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 290357 T737 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 290360 T737 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 290360 T737 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 290361 T737 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 290362 T737 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 290362 T737 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 290362 T737 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 290362 T737 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 290364 T737 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 290364 T737 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 290375 T737 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 290388 T737 oass.SolrIndexSearcher.<init> Opening Searcher@95d9a5 main
[junit4:junit4] 2> 290391 T737 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 290391 T737 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 290399 T738 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@95d9a5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 290402 T737 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 290403 T737 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52369/rme/b collection:collection1 shard:shard3
[junit4:junit4] 2> 290405 T737 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 290423 T737 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 290430 T737 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 290430 T737 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 290430 T737 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52369/rme/b/collection1/
[junit4:junit4] 2> 290430 T737 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 290430 T737 oasc.SyncStrategy.syncToMe http://127.0.0.1:52369/rme/b/collection1/ has no replicas
[junit4:junit4] 2> 290430 T737 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52369/rme/b/collection1/
[junit4:junit4] 2> 290430 T737 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 291504 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 291530 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 291531 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 291531 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 291531 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 291533 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 291555 T737 oasc.ZkController.register We are http://127.0.0.1:52369/rme/b/collection1/ and leader is http://127.0.0.1:52369/rme/b/collection1/
[junit4:junit4] 2> 291555 T737 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52369/rme/b
[junit4:junit4] 2> 291556 T737 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 291556 T737 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 291556 T737 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 291560 T737 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 291563 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 291563 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 291563 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 292157 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 292167 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52378
[junit4:junit4] 2> 292169 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 292170 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 292171 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915
[junit4:junit4] 2> 292171 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915\solr.xml
[junit4:junit4] 2> 292172 T662 oasc.CoreContainer.<init> New CoreContainer 4106291
[junit4:junit4] 2> 292173 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915\'
[junit4:junit4] 2> 292173 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915\'
[junit4:junit4] 2> 292392 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 292394 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 292394 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 292395 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 292396 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 292396 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 292397 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 292398 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 292398 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 292399 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 292414 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 292415 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 292416 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 292419 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 292439 T750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c2a8c4 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 292440 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 292445 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 292479 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 292492 T752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef63da name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 292493 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 292504 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 293043 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 293045 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52369_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52369_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52369/rme/b"}
[junit4:junit4] 2> 293066 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293067 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293068 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293068 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293070 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293070 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293505 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52378_rme%2Fb
[junit4:junit4] 2> 293508 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52378_rme%2Fb
[junit4:junit4] 2> 293520 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293522 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293522 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293523 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293525 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293525 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 293532 T752 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 293532 T736 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 293532 T720 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 293533 T704 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 293533 T684 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 293536 T691 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 293547 T753 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 293547 T753 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 294575 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 294577 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52378_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52378/rme/b"}
[junit4:junit4] 2> 294577 T685 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 294577 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 294595 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 294596 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 294597 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 294597 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 294596 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 294596 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 295541 T753 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915\collection1
[junit4:junit4] 2> 295541 T753 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 295543 T753 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 295543 T753 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 295545 T753 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915\collection1\'
[junit4:junit4] 2> 295549 T753 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 295550 T753 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915/collection1/lib/README' to classloader
[junit4:junit4] 2> 295622 T753 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 295695 T753 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 295699 T753 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 295706 T753 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 296630 T753 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 296644 T753 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 296650 T753 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 296674 T753 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 296681 T753 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 296687 T753 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 296689 T753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 296691 T753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 296691 T753 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 296694 T753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 296694 T753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 296695 T753 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 296695 T753 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371426974915\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty4\
[junit4:junit4] 2> 296695 T753 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 296695 T753 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 296696 T753 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4
[junit4:junit4] 2> 296697 T753 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty4\index/
[junit4:junit4] 2> 296698 T753 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 296699 T753 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index
[junit4:junit4] 2> 296713 T753 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 296713 T753 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 296718 T753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 296718 T753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 296720 T753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 296721 T753 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 296722 T753 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 296723 T753 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 296723 T753 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 296724 T753 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 296726 T753 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 296737 T753 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 296752 T753 oass.SolrIndexSearcher.<init> Opening Searcher@e965f8 main
[junit4:junit4] 2> 296754 T753 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 296754 T753 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 296763 T754 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e965f8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 296765 T753 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 296765 T753 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52378/rme/b collection:collection1 shard:shard1
[junit4:junit4] 2> 296773 T753 oasc.ZkController.register We are http://127.0.0.1:52378/rme/b/collection1/ and leader is http://127.0.0.1:52351/rme/b/collection1/
[junit4:junit4] 2> 296773 T753 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52378/rme/b
[junit4:junit4] 2> 296774 T753 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 296774 T753 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1452 name=collection1 org.apache.solr.core.SolrCore@b3596b url=http://127.0.0.1:52378/rme/b/collection1 node=127.0.0.1:52378_rme%2Fb C1452_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52378_rme%2Fb, base_url=http://127.0.0.1:52378/rme/b}
[junit4:junit4] 2> 296775 T755 C1452 P52378 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 296777 T755 C1452 P52378 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 296777 T755 C1452 P52378 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 296778 T755 C1452 P52378 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 296778 T753 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 296782 T755 C1452 P52378 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 296792 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 296793 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 296793 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 296800 T700 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52378_rme%2Fb_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 297419 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 297427 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52388
[junit4:junit4] 2> 297429 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 297429 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 297431 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140
[junit4:junit4] 2> 297431 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140\solr.xml
[junit4:junit4] 2> 297432 T662 oasc.CoreContainer.<init> New CoreContainer 32830865
[junit4:junit4] 2> 297432 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140\'
[junit4:junit4] 2> 297434 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140\'
[junit4:junit4] 2> 297600 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 297601 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 297601 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 297602 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 297602 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 297603 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 297604 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 297604 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 297605 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 297605 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 297616 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 297617 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 297619 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 297636 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 297650 T767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@84266 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 297652 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 297657 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 297658 T664 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4f6a9820000d, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 297672 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 297679 T769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@153d922 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 297680 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 297693 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 297804 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 297805 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52378_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52378_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52378/rme/b"}
[junit4:junit4] 2> 297817 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297819 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297820 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297820 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297821 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297823 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297823 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 297895 T700 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52378_rme%2Fb_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 297896 T700 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52378_rme%252Fb_collection1&state=recovering&nodeName=127.0.0.1:52378_rme%252Fb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1096
[junit4:junit4] 2> 298794 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52388_rme%2Fb
[junit4:junit4] 2> 298798 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52388_rme%2Fb
[junit4:junit4] 2> 298804 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 298806 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 298807 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 298807 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 298806 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 298809 T769 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298811 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 298808 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 298820 T704 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298821 T684 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298822 T736 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298823 T691 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298823 T752 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298825 T720 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 298839 T770 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 298839 T770 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 299479 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 299480 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52388_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52388/rme/b"}
[junit4:junit4] 2> 299480 T685 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 299480 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 299495 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299498 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299498 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299499 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299496 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299498 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299499 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 299938 T770 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140\collection1
[junit4:junit4] 2> 299938 T770 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 299940 T770 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 299941 T770 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 299944 T770 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140\collection1\'
[junit4:junit4] 2> 299948 T770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 299951 T770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140/collection1/lib/README' to classloader
[junit4:junit4] 2> 300044 T770 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> ASYNC NEW_CORE C1453 name=collection1 org.apache.solr.core.SolrCore@b3596b url=http://127.0.0.1:52378/rme/b/collection1 node=127.0.0.1:52378_rme%2Fb C1453_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52378_rme%2Fb, base_url=http://127.0.0.1:52378/rme/b}
[junit4:junit4] 2> 300103 T755 C1453 P52378 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52351/rme/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 300104 T755 C1453 P52378 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52378/rme/b START replicas=[http://127.0.0.1:52351/rme/b/collection1/] nUpdates=100
[junit4:junit4] 2> 300106 T755 C1453 P52378 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 300107 T755 C1453 P52378 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 300107 T755 C1453 P52378 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 300107 T755 C1453 P52378 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 300107 T755 C1453 P52378 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 300107 T755 C1453 P52378 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52351/rme/b/collection1/. core=collection1
[junit4:junit4] 2> 300108 T755 C1453 P52378 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1454 name=collection1 org.apache.solr.core.SolrCore@1fccc40 url=http://127.0.0.1:52351/rme/b/collection1 node=127.0.0.1:52351_rme%2Fb C1454_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52351_rme%2Fb, base_url=http://127.0.0.1:52351/rme/b, leader=true}
[junit4:junit4] 2> 300138 T697 C1454 P52351 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 300140 T698 C1454 P52351 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 300153 T698 C1454 P52351 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 300155 T698 C1454 P52351 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 300187 T698 C1454 P52351 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 300188 T698 C1454 P52351 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 300193 T698 C1454 P52351 oass.SolrIndexSearcher.<init> Opening Searcher@127ea2a realtime
[junit4:junit4] 2> 300194 T698 C1454 P52351 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 300195 T698 C1454 P52351 oasup.LogUpdateProcessor.finish [collection1] webapp=/rme/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 55
[junit4:junit4] 2> 300196 T755 C1453 P52378 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 300197 T755 C1453 P52378 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 300203 T695 C1454 P52351 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 300204 T695 C1454 P52351 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 300205 T755 C1453 P52378 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 300205 T755 C1453 P52378 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 300205 T755 C1453 P52378 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 300211 T696 C1454 P52351 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=3
[junit4:junit4] 2> 300212 T755 C1453 P52378 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 300217 T755 C1453 P52378 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index.20130616175623550
[junit4:junit4] 2> 300220 T755 C1453 P52378 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index.20130616175623550 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9a1f98 fullCopy=false
[junit4:junit4] 2> 300225 T700 C1454 P52351 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 300228 T755 C1453 P52378 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 300230 T770 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 300234 T770 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 300238 T755 C1453 P52378 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 300239 T755 C1453 P52378 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 300248 T755 C1453 P52378 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 300250 T755 C1453 P52378 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 300250 T755 C1453 P52378 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 300254 T755 C1453 P52378 oass.SolrIndexSearcher.<init> Opening Searcher@179e055 main
[junit4:junit4] 2> 300256 T754 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@179e055 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 300257 T755 C1453 P52378 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index.20130616175623550 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index.20130616175623550;done=true>>]
[junit4:junit4] 2> 300258 T755 C1453 P52378 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index.20130616175623550
[junit4:junit4] 2> 300258 T755 C1453 P52378 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty4\index.20130616175623550
[junit4:junit4] 2> 300262 T755 C1453 P52378 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 300263 T755 C1453 P52378 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 300263 T755 C1453 P52378 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 300263 T755 C1453 P52378 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 300267 T755 C1453 P52378 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 300267 T770 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 301156 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 301157 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52378_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52378_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52378/rme/b"}
[junit4:junit4] 2> 301175 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301176 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301177 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301177 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301179 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301179 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301181 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 301432 T770 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 301451 T770 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 301458 T770 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 301486 T770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 301506 T770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 301514 T770 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 301517 T770 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 301518 T770 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 301518 T770 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 301520 T770 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 301520 T770 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 301521 T770 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 301521 T770 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371426980140\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty5\
[junit4:junit4] 2> 301521 T770 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 301523 T770 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 301525 T770 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5
[junit4:junit4] 2> 301525 T770 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty5\index/
[junit4:junit4] 2> 301527 T770 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 301527 T770 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index
[junit4:junit4] 2> 301541 T770 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 301541 T770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 301546 T770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 301546 T770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 301547 T770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 301548 T770 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 301549 T770 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 301549 T770 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 301556 T770 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 301557 T770 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 301557 T770 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 301570 T770 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 301582 T770 oass.SolrIndexSearcher.<init> Opening Searcher@153a9b0 main
[junit4:junit4] 2> 301584 T770 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 301584 T770 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 301594 T773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@153a9b0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 301597 T770 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 301599 T770 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52388/rme/b collection:collection1 shard:shard2
[junit4:junit4] 2> 301607 T770 oasc.ZkController.register We are http://127.0.0.1:52388/rme/b/collection1/ and leader is http://127.0.0.1:52360/rme/b/collection1/
[junit4:junit4] 2> 301607 T770 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52388/rme/b
[junit4:junit4] 2> 301608 T770 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 301608 T770 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1455 name=collection1 org.apache.solr.core.SolrCore@a94b8e url=http://127.0.0.1:52388/rme/b/collection1 node=127.0.0.1:52388_rme%2Fb C1455_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52388_rme%2Fb, base_url=http://127.0.0.1:52388/rme/b}
[junit4:junit4] 2> 301609 T774 C1455 P52388 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 301610 T770 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 301611 T774 C1455 P52388 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 301611 T774 C1455 P52388 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 301611 T774 C1455 P52388 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 301613 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 301614 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 301614 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 301615 T774 C1455 P52388 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 301632 T714 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52388_rme%2Fb_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 302118 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 302124 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52401
[junit4:junit4] 2> 302125 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 302126 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 302126 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965
[junit4:junit4] 2> 302126 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965\solr.xml
[junit4:junit4] 2> 302127 T662 oasc.CoreContainer.<init> New CoreContainer 25056563
[junit4:junit4] 2> 302127 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965\'
[junit4:junit4] 2> 302128 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965\'
[junit4:junit4] 2> 302277 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 302277 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 302278 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 302278 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 302279 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 302279 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 302280 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 302280 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 302280 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 302281 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 302292 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 302293 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 302293 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 302296 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 302315 T786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d45581 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 302316 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 302322 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 302331 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 302336 T788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c45690 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 302337 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 302347 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 302838 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 302839 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52388_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52388_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52388/rme/b"}
[junit4:junit4] 2> 302852 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302853 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302853 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302853 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302854 T788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302854 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302855 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 302856 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303447 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52401_rme%2Fb
[junit4:junit4] 2> 303458 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52401_rme%2Fb
[junit4:junit4] 2> 303463 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303464 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303464 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303465 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303465 T788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303466 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303466 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 303472 T769 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303472 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 303478 T704 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303478 T752 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303479 T684 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303480 T736 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303480 T788 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303481 T720 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303481 T691 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 303493 T789 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 303493 T789 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 303821 T714 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52388_rme%2Fb_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 303822 T714 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52388_rme%252Fb_collection1&state=recovering&nodeName=127.0.0.1:52388_rme%252Fb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2190
[junit4:junit4] 2> 304519 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 304522 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52401_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52401/rme/b"}
[junit4:junit4] 2> 304523 T685 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 304523 T685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 304536 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304536 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304537 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304537 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304537 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304538 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304538 T788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304539 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 304590 T789 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965\collection1
[junit4:junit4] 2> 304590 T789 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 304593 T789 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 304593 T789 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 304596 T789 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965\collection1\'
[junit4:junit4] 2> 304598 T789 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 304599 T789 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965/collection1/lib/README' to classloader
[junit4:junit4] 2> 304683 T789 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 304798 T789 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 304802 T789 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 304814 T789 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 305721 T789 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 305777 T789 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 305782 T789 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 305810 T789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 305817 T789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 305824 T789 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 305827 T789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 305827 T789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 305828 T789 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 305829 T789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 305830 T789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 305830 T789 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 305830 T789 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371426984965\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty6\
[junit4:junit4] 2> 305830 T789 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ed1bf6
[junit4:junit4] 2> 305831 T789 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 305832 T789 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty6
[junit4:junit4] 2> 305833 T789 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239/jetty6\index/
[junit4:junit4] 2> 305835 T789 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty6\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 305835 T789 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty6\index
[junit4:junit4] 2> 305848 T789 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty6\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 305849 T789 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 305852 T789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 305854 T789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 305854 T789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 305855 T789 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 305856 T789 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 305856 T789 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 305857 T789 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 305858 T789 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 305858 T789 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 305871 T789 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 305883 T789 oass.SolrIndexSearcher.<init> Opening Searcher@1249511 main
[junit4:junit4] 2> 305886 T789 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 305887 T789 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 305896 T790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1249511 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 305898 T789 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 305898 T789 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52401/rme/b collection:collection1 shard:shard3
[junit4:junit4] 2> 305907 T789 oasc.ZkController.register We are http://127.0.0.1:52401/rme/b/collection1/ and leader is http://127.0.0.1:52369/rme/b/collection1/
[junit4:junit4] 2> 305907 T789 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52401/rme/b
[junit4:junit4] 2> 305907 T789 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 305907 T789 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1456 name=collection1 org.apache.solr.core.SolrCore@1e1ca7c url=http://127.0.0.1:52401/rme/b/collection1 node=127.0.0.1:52401_rme%2Fb C1456_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52401_rme%2Fb, base_url=http://127.0.0.1:52401/rme/b}
[junit4:junit4] 2> 305909 T791 C1456 P52401 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 305910 T791 C1456 P52401 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 305910 T791 C1456 P52401 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 305911 T791 C1456 P52401 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 305911 T789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 305914 T791 C1456 P52401 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 305917 T662 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 305918 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 305918 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 305933 T732 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52401_rme%2Fb_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> ASYNC NEW_CORE C1457 name=collection1 org.apache.solr.core.SolrCore@a94b8e url=http://127.0.0.1:52388/rme/b/collection1 node=127.0.0.1:52388_rme%2Fb C1457_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52388_rme%2Fb, base_url=http://127.0.0.1:52388/rme/b}
[junit4:junit4] 2> 306012 T774 C1457 P52388 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52360/rme/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 306012 T774 C1457 P52388 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52388/rme/b START replicas=[http://127.0.0.1:52360/rme/b/collection1/] nUpdates=100
[junit4:junit4] 2> 306013 T774 C1457 P52388 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 306016 T774 C1457 P52388 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 306026 T774 C1457 P52388 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 306026 T774 C1457 P52388 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 306026 T774 C1457 P52388 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 306026 T774 C1457 P52388 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52360/rme/b/collection1/. core=collection1
[junit4:junit4] 2> 306027 T774 C1457 P52388 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1458 name=collection1 org.apache.solr.core.SolrCore@13fbfc0 url=http://127.0.0.1:52360/rme/b/collection1 node=127.0.0.1:52360_rme%2Fb C1458_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52360_rme%2Fb, base_url=http://127.0.0.1:52360/rme/b, leader=true}
[junit4:junit4] 2> 306031 T715 C1458 P52360 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 306041 T716 C1458 P52360 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 306052 T716 C1458 P52360 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 306053 T716 C1458 P52360 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 306067 T716 C1458 P52360 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 306068 T716 C1458 P52360 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 306074 T716 C1458 P52360 oass.SolrIndexSearcher.<init> Opening Searcher@dd823b realtime
[junit4:junit4] 2> 306074 T716 C1458 P52360 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 306075 T716 C1458 P52360 oasup.LogUpdateProcessor.finish [collection1] webapp=/rme/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 34
[junit4:junit4] 2> 306076 T774 C1457 P52388 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 306077 T774 C1457 P52388 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 306082 T711 C1458 P52360 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 306083 T711 C1458 P52360 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 306083 T774 C1457 P52388 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 306084 T774 C1457 P52388 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 306084 T774 C1457 P52388 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 306090 T713 C1458 P52360 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=4
[junit4:junit4] 2> 306092 T774 C1457 P52388 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 306094 T774 C1457 P52388 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index.20130616175629429
[junit4:junit4] 2> 306098 T774 C1457 P52388 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index.20130616175629429 lockFactory=org.apache.lucene.store.NativeFSLockFactory@421f3c fullCopy=false
[junit4:junit4] 2> 306103 T714 C1458 P52360 oasc.SolrCore.execute [collection1] webapp=/rme/b path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 306105 T774 C1457 P52388 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 306114 T774 C1457 P52388 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 306114 T774 C1457 P52388 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 306124 T774 C1457 P52388 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 306125 T774 C1457 P52388 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 306127 T774 C1457 P52388 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 306130 T774 C1457 P52388 oass.SolrIndexSearcher.<init> Opening Searcher@8b6b20 main
[junit4:junit4] 2> 306132 T773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8b6b20 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 306134 T774 C1457 P52388 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index.20130616175629429 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index.20130616175629429;done=true>>]
[junit4:junit4] 2> 306135 T774 C1457 P52388 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index.20130616175629429
[junit4:junit4] 2> 306135 T774 C1457 P52388 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty5\index.20130616175629429
[junit4:junit4] 2> 306137 T774 C1457 P52388 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 306137 T774 C1457 P52388 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 306137 T774 C1457 P52388 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 306138 T774 C1457 P52388 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 306144 T774 C1457 P52388 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 306194 T685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 306197 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52401_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52401_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52401/rme/b"}
[junit4:junit4] 2> 306207 T685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52388_rme%2Fb_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52388_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52388/rme/b"}
[junit4:junit4] 2> 306219 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306220 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306220 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306220 T788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306220 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306221 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306220 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306220 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 306471 T662 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 306478 T662 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52414
[junit4:junit4] 2> 306479 T662 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 306480 T662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 306480 T662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371426989267
[junit4:junit4] 2> 306480 T662 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371426989267\solr.xml
[junit4:junit4] 2> 306482 T662 oasc.CoreContainer.<init> New CoreContainer 18983696
[junit4:junit4] 2> 306482 T662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371426989267\'
[junit4:junit4] 2> 306482 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371426989267\'
[junit4:junit4] 2> 306664 T662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 306664 T662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 306665 T662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 306665 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 306665 T662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 306665 T662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 306666 T662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 306666 T662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 306668 T662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 306669 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 306693 T662 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 306695 T662 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52332/solr
[junit4:junit4] 2> 306696 T662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 306699 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 306712 T805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f86b77 name:ZooKeeperConnection Watcher:127.0.0.1:52332 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 306713 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 306719 T664 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4f6a98200011, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 306721 T662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 306735 T662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 306739 T807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1048cb9 name:ZooKeeperConnection Watcher:127.0.0.1:52332/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 306740 T662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 306757 T662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 307080 T732 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52401_rme%2Fb_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 307081 T732 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52401_rme%252Fb_collection1&state=recovering&nodeName=127.0.0.1:52401_rme%252Fb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1148
[junit4:junit4] 2> 307969 T662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52414_rme%2Fb
[junit4:junit4] 2> 307976 T662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52414_rme%2Fb
[junit4:junit4] 2> 307983 T691 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 307985 T720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 307987 T788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 307987 T736 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 307989 T752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 307990 T704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 307996 T807 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 307996 T684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 308001 T788 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308002 T769 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308002 T769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 308004 T736 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308004 T720 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308005 T752 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308009 T704 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308009 T691 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308011 T684 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 308021 T808 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 308021 T808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C1456_STATE=coll:collection1 core:collection1 props:{shard=shard3, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52401_rme%2Fb, base_url=http://127.0.0.1:52401/rme/b}
[junit4:junit4] 2> 309490 T791 C1456 P52401 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52369/rme/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 309490 T791 C1456 P52401 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52401/rme/b START replicas=[http://127.0.0.1:52369/rme/b/collection1/] nUpdates=100
[junit4:junit4] 2> 309492 T791 C1456 P52401 oasu.PeerSync.sync WARN no frame of reference to tell of we've
[...truncated too long message...]
tateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52471_rme%2Fb_collection1",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52471_rme%2Fb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52471/rme/b"}
[junit4:junit4] 2> 521069 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 521652 T662 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 521653 T662 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 521659 T662 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@b3c75a
[junit4:junit4] 2> 521661 T662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1190,cumulative_deletesById=572,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 521664 T662 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 521664 T662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 521664 T662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 521668 T662 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 521668 T662 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 521669 T662 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty12\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty12\index;done=false>>]
[junit4:junit4] 2> 521669 T662 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty12\index
[junit4:junit4] 2> 521670 T662 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty12 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty12;done=false>>]
[junit4:junit4] 2> 521670 T662 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\jetty12
[junit4:junit4] 2> 521671 T1103 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89877836808060956-127.0.0.1:52471_rme%2Fb-n_0000000012) am no longer a leader.
[junit4:junit4] 2> 521675 T902 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 521675 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 521675 T902 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 521688 T662 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/rme/b,null}
[junit4:junit4] 2> 521868 T972 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 521868 T972 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 521868 T972 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\zookeeper\server1\data\version-2\log.1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\zookeeper\server1\data\version-2 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\zookeeper\server1\data FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\zookeeper\server1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239\zookeeper FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371426953239 FAILED !!!!!
[junit4:junit4] 2> 522216 T662 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 522219 T662 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52332 52332
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.method=testDistribSearch -Dtests.seed=F52577DB69AC6D2F -Dtests.slow=true -Dtests.locale=ru -Dtests.timezone=Canada/Saskatchewan -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 255s | ChaosMonkeySafeLeaderTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard2 is not consistent. Got 620 from http://127.0.0.1:52427/rme/b/collection1lastClient and got 611 from http://127.0.0.1:52460/rme/b/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F52577DB69AC6D2F:74C3F9C31EF30D13]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 524488 T662 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=381), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=381)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ru, timezone=Canada/Saskatchewan
[junit4:junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_21 (32-bit)/cpus=2,threads=2,free=146441328,total=260046848
[junit4:junit4] 2> NOTE: All tests run in this JVM: [BasicDistributedZk2Test, XmlUpdateRequestHandlerTest, TestFieldCollectionResource, TestSolrDeletionPolicy1, TestCoreDiscovery, DocumentAnalysisRequestHandlerTest, OpenCloseCoreStressTest, DateFieldTest, UpdateParamsTest, SolrIndexSplitterTest, TestRealTimeGet, OpenExchangeRatesOrgProviderTest, ChaosMonkeyNothingIsSafeTest, FieldMutatingUpdateProcessorTest, SuggesterFSTTest, MoreLikeThisHandlerTest, RequiredFieldsTest, TestUtils, TestDFRSimilarityFactory, ChaosMonkeySafeLeaderTest]
[junit4:junit4] Completed in 254.63s, 1 test, 1 failure <<< FAILURES!
[...truncated 856 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 failure, 18 ignored (12 assumptions)
Total time: 71 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_21) - Build #
2897 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2897/
Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard3 is not consistent. Got 582 from http://127.0.0.1:56159/_xo/vn/collection1lastClient and got 578 from http://127.0.0.1:56192/_xo/vn/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 582 from http://127.0.0.1:56159/_xo/vn/collection1lastClient and got 578 from http://127.0.0.1:56192/_xo/vn/collection1
at __randomizedtesting.SeedInfo.seed([473B937C701732D2:C6DD1D64074852EE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9320 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 158143 T368 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_xo/vn
[junit4:junit4] 2> 158168 T368 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1371391116360
[junit4:junit4] 2> 158170 T368 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 158171 T369 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 158272 T368 oasc.ZkTestServer.run start zk server on port:56053
[junit4:junit4] 2> 158275 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 158283 T375 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45b029 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 158283 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 158284 T368 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 158293 T370 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4d47c4530000, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 158294 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 158298 T377 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cb5a24 name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 158299 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 158299 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 158307 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 158312 T368 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 158317 T368 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 158324 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 158326 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 158338 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 158338 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 158345 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 158346 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 158353 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 158354 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 158360 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 158360 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 158367 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 158367 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 158374 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 158375 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 158379 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 158380 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 158385 T368 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 158385 T368 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 158396 T370 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4d47c4530001, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 158830 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 158841 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56060
[junit4:junit4] 2> 158842 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 158843 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 158843 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587
[junit4:junit4] 2> 158843 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587\solr.xml
[junit4:junit4] 2> 158844 T368 oasc.CoreContainer.<init> New CoreContainer 7371526
[junit4:junit4] 2> 158845 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587\'
[junit4:junit4] 2> 158845 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587\'
[junit4:junit4] 2> 158974 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 158975 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 158975 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 158976 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 158976 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 158976 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 158977 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 158977 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 158978 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 158978 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 158988 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 158989 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 158989 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 158994 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 159009 T388 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19e5364 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 159010 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 159014 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 159022 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 159026 T390 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f19c46 name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 159027 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 159030 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 159037 T368 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 159043 T368 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 159047 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56060__xo%2Fvn
[junit4:junit4] 2> 159049 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56060__xo%2Fvn
[junit4:junit4] 2> 159056 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 159067 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 159073 T368 oasc.Overseer.start Overseer (id=89875488202489859-127.0.0.1:56060__xo%2Fvn-n_0000000000) starting
[junit4:junit4] 2> 159084 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 159095 T392 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 159096 T368 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 159107 T368 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 159110 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 159119 T391 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 159127 T393 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 159128 T393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 160626 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 160628 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56060__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56060/_xo/vn"}
[junit4:junit4] 2> 160628 T391 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 160632 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 160648 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 161130 T393 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587\collection1
[junit4:junit4] 2> 161130 T393 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 161132 T393 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 161132 T393 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 161136 T393 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587\collection1\'
[junit4:junit4] 2> 161140 T393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 161141 T393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587/collection1/lib/README' to classloader
[junit4:junit4] 2> 161236 T393 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 161309 T393 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 161312 T393 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 161319 T393 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 162132 T393 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 162148 T393 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 162156 T393 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 162178 T393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 162184 T393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 162191 T393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 162193 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 162193 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 162193 T393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 162195 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 162195 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 162196 T393 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 162230 T393 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371391116587\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/control/data\
[junit4:junit4] 2> 162231 T393 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 162231 T393 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 162233 T393 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\control\data
[junit4:junit4] 2> 162233 T393 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/control/data\index/
[junit4:junit4] 2> 162235 T393 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 162235 T393 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\control\data\index
[junit4:junit4] 2> 162247 T393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 162248 T393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 162251 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 162251 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 162251 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 162252 T393 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 162253 T393 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 162253 T393 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 162254 T393 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 162254 T393 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 162255 T393 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 162267 T393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 162278 T393 oass.SolrIndexSearcher.<init> Opening Searcher@106b6e6 main
[junit4:junit4] 2> 162281 T393 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 162281 T393 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 162288 T394 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@106b6e6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 162289 T393 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 162289 T393 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56060/_xo/vn collection:control_collection shard:shard1
[junit4:junit4] 2> 162291 T393 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 162310 T393 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 162317 T393 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 162317 T393 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 162318 T393 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56060/_xo/vn/collection1/
[junit4:junit4] 2> 162318 T393 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 162318 T393 oasc.SyncStrategy.syncToMe http://127.0.0.1:56060/_xo/vn/collection1/ has no replicas
[junit4:junit4] 2> 162318 T393 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56060/_xo/vn/collection1/
[junit4:junit4] 2> 162318 T393 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 163664 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 163683 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 163705 T393 oasc.ZkController.register We are http://127.0.0.1:56060/_xo/vn/collection1/ and leader is http://127.0.0.1:56060/_xo/vn/collection1/
[junit4:junit4] 2> 163705 T393 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56060/_xo/vn
[junit4:junit4] 2> 163705 T393 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 163706 T393 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 163706 T393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 163709 T393 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 163711 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 163712 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 163712 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 163724 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 163733 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 163738 T397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e1f3bf name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 163739 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 163744 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 163757 T368 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 164236 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 164244 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56072
[junit4:junit4] 2> 164246 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 164246 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 164247 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948
[junit4:junit4] 2> 164248 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948\solr.xml
[junit4:junit4] 2> 164249 T368 oasc.CoreContainer.<init> New CoreContainer 16469046
[junit4:junit4] 2> 164249 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948\'
[junit4:junit4] 2> 164250 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948\'
[junit4:junit4] 2> 164385 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 164386 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 164386 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 164387 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 164387 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 164388 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 164388 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 164389 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 164389 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 164390 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 164404 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 164405 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 164405 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 164408 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 164427 T408 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc646f name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 164429 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 164434 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 164457 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 164463 T410 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4aaec5 name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 164464 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 164476 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 165199 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 165200 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56060__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56060__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56060/_xo/vn"}
[junit4:junit4] 2> 165209 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 165209 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 165209 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 165481 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56072__xo%2Fvn
[junit4:junit4] 2> 165484 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56072__xo%2Fvn
[junit4:junit4] 2> 165489 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 165490 T397 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 165491 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 165489 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 165496 T410 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 165497 T390 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 165506 T411 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 165507 T411 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 166719 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 166720 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56072__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56072/_xo/vn"}
[junit4:junit4] 2> 166720 T391 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 166720 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 166733 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 166734 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 166734 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 167510 T411 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948\collection1
[junit4:junit4] 2> 167510 T411 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 167513 T411 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 167513 T411 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 167517 T411 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948\collection1\'
[junit4:junit4] 2> 167520 T411 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 167521 T411 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948/collection1/lib/README' to classloader
[junit4:junit4] 2> 167597 T411 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 167668 T411 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 167671 T411 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 167678 T411 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 168504 T411 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 168515 T411 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 168522 T411 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 168543 T411 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 168550 T411 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 168555 T411 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 168558 T411 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 168558 T411 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 168558 T411 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 168560 T411 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 168560 T411 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 168560 T411 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 168561 T411 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371391121948\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty1\
[junit4:junit4] 2> 168561 T411 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 168562 T411 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 168563 T411 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1
[junit4:junit4] 2> 168564 T411 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty1\index/
[junit4:junit4] 2> 168564 T411 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 168565 T411 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1\index
[junit4:junit4] 2> 168577 T411 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 168577 T411 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 168581 T411 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 168581 T411 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 168583 T411 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 168584 T411 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 168584 T411 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 168584 T411 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 168584 T411 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 168584 T411 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 168585 T411 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 168596 T411 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 168609 T411 oass.SolrIndexSearcher.<init> Opening Searcher@81a48c main
[junit4:junit4] 2> 168611 T411 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 168611 T411 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 168620 T412 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@81a48c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 168622 T411 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 168622 T411 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56072/_xo/vn collection:collection1 shard:shard1
[junit4:junit4] 2> 168624 T411 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 168640 T411 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 168647 T411 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 168647 T411 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 168647 T411 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56072/_xo/vn/collection1/
[junit4:junit4] 2> 168648 T411 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 168648 T411 oasc.SyncStrategy.syncToMe http://127.0.0.1:56072/_xo/vn/collection1/ has no replicas
[junit4:junit4] 2> 168649 T411 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56072/_xo/vn/collection1/
[junit4:junit4] 2> 168649 T411 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 169823 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 169843 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 169843 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 169843 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 169866 T411 oasc.ZkController.register We are http://127.0.0.1:56072/_xo/vn/collection1/ and leader is http://127.0.0.1:56072/_xo/vn/collection1/
[junit4:junit4] 2> 169866 T411 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56072/_xo/vn
[junit4:junit4] 2> 169866 T411 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 169867 T411 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 169867 T411 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 169872 T411 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 169873 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 169874 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 169874 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 170350 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 170356 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56081
[junit4:junit4] 2> 170358 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 170359 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 170361 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076
[junit4:junit4] 2> 170361 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076\solr.xml
[junit4:junit4] 2> 170362 T368 oasc.CoreContainer.<init> New CoreContainer 5780407
[junit4:junit4] 2> 170363 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076\'
[junit4:junit4] 2> 170363 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076\'
[junit4:junit4] 2> 170512 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 170512 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 170513 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 170513 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 170514 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 170515 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 170515 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 170516 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 170516 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 170517 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 170533 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 170535 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 170536 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 170539 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 170558 T424 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d26bd2 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 170560 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 170601 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 170612 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 170629 T426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d6104 name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 170630 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 170645 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 171508 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 171509 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56072__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56072__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56072/_xo/vn"}
[junit4:junit4] 2> 171523 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 171523 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 171524 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 171523 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 171751 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56081__xo%2Fvn
[junit4:junit4] 2> 171754 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56081__xo%2Fvn
[junit4:junit4] 2> 171758 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 171759 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 171760 T397 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 171761 T426 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 171761 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 171761 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 171768 T410 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 171769 T390 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 171778 T427 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 171778 T427 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 173185 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 173186 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56081__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56081/_xo/vn"}
[junit4:junit4] 2> 173186 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 173186 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 173203 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 173203 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 173203 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 173203 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 173982 T427 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076\collection1
[junit4:junit4] 2> 173982 T427 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 173983 T427 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 173983 T427 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 173986 T427 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076\collection1\'
[junit4:junit4] 2> 173988 T427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 173989 T427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076/collection1/lib/README' to classloader
[junit4:junit4] 2> 174060 T427 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 174145 T427 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 174150 T427 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 174156 T427 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 175077 T427 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 175097 T427 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 175103 T427 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 175131 T427 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 175142 T427 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 175150 T427 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 175153 T427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 175154 T427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 175154 T427 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 175156 T427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 175156 T427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 175156 T427 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 175157 T427 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371391128076\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty2\
[junit4:junit4] 2> 175157 T427 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 175157 T427 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 175159 T427 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2
[junit4:junit4] 2> 175160 T427 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty2\index/
[junit4:junit4] 2> 175161 T427 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 175161 T427 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2\index
[junit4:junit4] 2> 175174 T427 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 175174 T427 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 175177 T427 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 175178 T427 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 175179 T427 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 175180 T427 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 175180 T427 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 175182 T427 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 175182 T427 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 175183 T427 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 175183 T427 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 175197 T427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 175209 T427 oass.SolrIndexSearcher.<init> Opening Searcher@e5775b main
[junit4:junit4] 2> 175213 T427 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 175213 T427 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 175220 T428 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e5775b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 175223 T427 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 175223 T427 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56081/_xo/vn collection:collection1 shard:shard2
[junit4:junit4] 2> 175225 T427 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 175241 T427 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 175247 T427 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 175247 T427 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 175248 T427 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56081/_xo/vn/collection1/
[junit4:junit4] 2> 175248 T427 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 175248 T427 oasc.SyncStrategy.syncToMe http://127.0.0.1:56081/_xo/vn/collection1/ has no replicas
[junit4:junit4] 2> 175248 T427 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56081/_xo/vn/collection1/
[junit4:junit4] 2> 175248 T427 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 176518 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 176557 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 176558 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 176558 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 176558 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 176603 T427 oasc.ZkController.register We are http://127.0.0.1:56081/_xo/vn/collection1/ and leader is http://127.0.0.1:56081/_xo/vn/collection1/
[junit4:junit4] 2> 176603 T427 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56081/_xo/vn
[junit4:junit4] 2> 176604 T427 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 176604 T427 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 176604 T427 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 176612 T427 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 176617 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 176618 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 176619 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 177148 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 177157 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56090
[junit4:junit4] 2> 177159 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 177159 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 177159 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831
[junit4:junit4] 2> 177160 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831\solr.xml
[junit4:junit4] 2> 177161 T368 oasc.CoreContainer.<init> New CoreContainer 21175051
[junit4:junit4] 2> 177162 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831\'
[junit4:junit4] 2> 177163 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831\'
[junit4:junit4] 2> 177292 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 177292 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 177292 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 177293 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 177293 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 177293 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 177295 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 177295 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 177296 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 177297 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 177305 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 177306 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 177306 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 177310 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 177334 T440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@187bb60 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 177335 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 177342 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 177356 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 177362 T442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@107473a name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 177363 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 177373 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 178222 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 178223 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56081__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56081__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56081/_xo/vn"}
[junit4:junit4] 2> 178237 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178238 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178238 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178239 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178238 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178478 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56090__xo%2Fvn
[junit4:junit4] 2> 178481 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56090__xo%2Fvn
[junit4:junit4] 2> 178488 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178488 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 178490 T397 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 178490 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 178491 T442 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 178491 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 178492 T426 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 178492 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 178495 T390 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 178498 T410 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 178508 T443 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 178508 T443 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 179906 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 179909 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56090__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56090/_xo/vn"}
[junit4:junit4] 2> 179909 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 179910 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 179940 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 179941 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 179942 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 179940 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 179943 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 180637 T443 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831\collection1
[junit4:junit4] 2> 180637 T443 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 180639 T443 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 180639 T443 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 180647 T443 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831\collection1\'
[junit4:junit4] 2> 180651 T443 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 180653 T443 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831/collection1/lib/README' to classloader
[junit4:junit4] 2> 180743 T443 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 180813 T443 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 180816 T443 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 180821 T443 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 181552 T443 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 181562 T443 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 181590 T443 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 181610 T443 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 181613 T443 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 181619 T443 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 181621 T443 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 181622 T443 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 181622 T443 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 181624 T443 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 181625 T443 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 181625 T443 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 181625 T443 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371391134831\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty3\
[junit4:junit4] 2> 181625 T443 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 181625 T443 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 181627 T443 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty3
[junit4:junit4] 2> 181628 T443 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty3\index/
[junit4:junit4] 2> 181629 T443 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 181629 T443 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty3\index
[junit4:junit4] 2> 181640 T443 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 181640 T443 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 181643 T443 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 181643 T443 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 181644 T443 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 181645 T443 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 181645 T443 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 181645 T443 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 181645 T443 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 181647 T443 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 181647 T443 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 181658 T443 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 181670 T443 oass.SolrIndexSearcher.<init> Opening Searcher@1276a46 main
[junit4:junit4] 2> 181671 T443 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 181671 T443 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 181678 T444 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1276a46 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 181683 T443 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 181683 T443 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56090/_xo/vn collection:collection1 shard:shard3
[junit4:junit4] 2> 181685 T443 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 181700 T443 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 181706 T443 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 181706 T443 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 181706 T443 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56090/_xo/vn/collection1/
[junit4:junit4] 2> 181706 T443 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 181706 T443 oasc.SyncStrategy.syncToMe http://127.0.0.1:56090/_xo/vn/collection1/ has no replicas
[junit4:junit4] 2> 181706 T443 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56090/_xo/vn/collection1/
[junit4:junit4] 2> 181706 T443 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 182939 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 182978 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 182979 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 182981 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 182981 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 182979 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 183028 T443 oasc.ZkController.register We are http://127.0.0.1:56090/_xo/vn/collection1/ and leader is http://127.0.0.1:56090/_xo/vn/collection1/
[junit4:junit4] 2> 183028 T443 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56090/_xo/vn
[junit4:junit4] 2> 183029 T443 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 183029 T443 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 183030 T443 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 183036 T443 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 183040 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 183040 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 183042 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 183472 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 183478 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56099
[junit4:junit4] 2> 183479 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 183479 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 183480 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254
[junit4:junit4] 2> 183480 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254\solr.xml
[junit4:junit4] 2> 183481 T368 oasc.CoreContainer.<init> New CoreContainer 13538081
[junit4:junit4] 2> 183481 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254\'
[junit4:junit4] 2> 183481 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254\'
[junit4:junit4] 2> 183603 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 183603 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 183603 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 183604 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 183605 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 183606 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 183606 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 183606 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 183607 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 183607 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 183615 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 183616 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 183617 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 183619 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 183635 T456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b23d07 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 183636 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 183640 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 183649 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 183652 T458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8906ab name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 183653 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 183665 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 184487 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 184488 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56090__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56090__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56090/_xo/vn"}
[junit4:junit4] 2> 184503 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184505 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184505 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184505 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184504 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184504 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184664 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56099__xo%2Fvn
[junit4:junit4] 2> 184668 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56099__xo%2Fvn
[junit4:junit4] 2> 184671 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184672 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184672 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 184673 T397 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 184673 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 184675 T442 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 184675 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 184676 T426 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 184676 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 184679 T410 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 184680 T390 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 184681 T458 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 184692 T459 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 184692 T459 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 186006 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 186008 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56099__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56099/_xo/vn"}
[junit4:junit4] 2> 186010 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 186010 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 186031 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 186031 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 186032 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 186033 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 186031 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 186033 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 186676 T459 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254\collection1
[junit4:junit4] 2> 186676 T459 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 186678 T459 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 186678 T459 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 186683 T459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254\collection1\'
[junit4:junit4] 2> 186687 T459 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 186690 T459 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254/collection1/lib/README' to classloader
[junit4:junit4] 2> 186767 T459 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 186834 T459 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 186836 T459 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 186846 T459 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 187637 T459 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 187653 T459 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 187658 T459 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 187677 T459 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 187682 T459 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 187687 T459 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 187691 T459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 187692 T459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 187692 T459 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 187694 T459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 187694 T459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 187694 T459 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 187695 T459 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371391141254\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty4\
[junit4:junit4] 2> 187695 T459 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 187695 T459 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 187696 T459 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4
[junit4:junit4] 2> 187698 T459 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty4\index/
[junit4:junit4] 2> 187698 T459 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 187699 T459 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index
[junit4:junit4] 2> 187712 T459 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 187712 T459 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 187715 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 187715 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 187717 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 187718 T459 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 187718 T459 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 187718 T459 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 187719 T459 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 187720 T459 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 187720 T459 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 187730 T459 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 187741 T459 oass.SolrIndexSearcher.<init> Opening Searcher@1eee8d2 main
[junit4:junit4] 2> 187743 T459 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 187743 T459 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 187750 T460 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1eee8d2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 187754 T459 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 187754 T459 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56099/_xo/vn collection:collection1 shard:shard1
[junit4:junit4] 2> 187759 T459 oasc.ZkController.register We are http://127.0.0.1:56099/_xo/vn/collection1/ and leader is http://127.0.0.1:56072/_xo/vn/collection1/
[junit4:junit4] 2> 187759 T459 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56099/_xo/vn
[junit4:junit4] 2> 187759 T459 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 187760 T459 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C113 name=collection1 org.apache.solr.core.SolrCore@1579329 url=http://127.0.0.1:56099/_xo/vn/collection1 node=127.0.0.1:56099__xo%2Fvn C113_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56099__xo%2Fvn, base_url=http://127.0.0.1:56099/_xo/vn}
[junit4:junit4] 2> 187767 T461 C113 P56099 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 187768 T461 C113 P56099 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 187768 T459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 187768 T461 C113 P56099 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 187769 T461 C113 P56099 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 187771 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 187772 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 187772 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 187772 T461 C113 P56099 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 187803 T406 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56099__xo%2Fvn_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 188193 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 188199 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56109
[junit4:junit4] 2> 188201 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 188201 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 188201 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975
[junit4:junit4] 2> 188202 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975\solr.xml
[junit4:junit4] 2> 188202 T368 oasc.CoreContainer.<init> New CoreContainer 18292782
[junit4:junit4] 2> 188203 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975\'
[junit4:junit4] 2> 188203 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975\'
[junit4:junit4] 2> 188333 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 188333 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 188333 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 188334 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 188334 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 188335 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 188335 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 188336 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 188336 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 188336 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 188344 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 188344 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 188345 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 188347 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 188368 T473 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@144cdbd name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 188369 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 188404 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 188404 T370 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f4d47c453000d, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 188422 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 188430 T475 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a94466 name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 188431 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 188451 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 189023 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 189025 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56099__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56099__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56099/_xo/vn"}
[junit4:junit4] 2> 189035 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189036 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189036 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189036 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189036 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189037 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189037 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189449 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56109__xo%2Fvn
[junit4:junit4] 2> 189456 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56109__xo%2Fvn
[junit4:junit4] 2> 189461 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189462 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189463 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189463 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 189466 T397 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189466 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 189468 T426 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189468 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 189469 T442 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189469 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 189475 T410 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189475 T458 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189475 T390 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189476 T475 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 189487 T476 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 189487 T476 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 189783 T406 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56099__xo%2Fvn_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 189783 T406 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56099__xo%252Fvn_collection1&state=recovering&nodeName=127.0.0.1:56099__xo%252Fvn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1986
[junit4:junit4] 2> 190466 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 190467 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56109__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56109/_xo/vn"}
[junit4:junit4] 2> 190467 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 190467 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 190479 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 190479 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 190480 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 190480 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 190479 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 190479 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 190479 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191309 T476 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975\collection1
[junit4:junit4] 2> 191309 T476 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 191310 T476 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 191310 T476 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 191313 T476 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975\collection1\'
[junit4:junit4] 2> 191315 T476 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 191316 T476 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975/collection1/lib/README' to classloader
[junit4:junit4] 2> 191375 T476 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 191475 T476 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 191477 T476 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 191483 T476 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C114 name=collection1 org.apache.solr.core.SolrCore@1579329 url=http://127.0.0.1:56099/_xo/vn/collection1 node=127.0.0.1:56099__xo%2Fvn C114_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56099__xo%2Fvn, base_url=http://127.0.0.1:56099/_xo/vn}
[junit4:junit4] 2> 191574 T461 C114 P56099 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56072/_xo/vn/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 191599 T461 C114 P56099 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 191611 T461 C114 P56099 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56099/_xo/vn START replicas=[http://127.0.0.1:56072/_xo/vn/collection1/] nUpdates=100
[junit4:junit4] 2> 191611 T461 C114 P56099 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 191612 T461 C114 P56099 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 191612 T461 C114 P56099 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 191612 T461 C114 P56099 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 191612 T461 C114 P56099 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 191613 T461 C114 P56099 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:56072/_xo/vn/collection1/. core=collection1
[junit4:junit4] 2> 191613 T461 C114 P56099 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C115 name=collection1 org.apache.solr.core.SolrCore@11971ec url=http://127.0.0.1:56072/_xo/vn/collection1 node=127.0.0.1:56072__xo%2Fvn C115_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56072__xo%2Fvn, base_url=http://127.0.0.1:56072/_xo/vn, leader=true}
[junit4:junit4] 2> 191630 T406 C115 P56072 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 191632 T403 C115 P56072 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 191637 T403 C115 P56072 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 191638 T403 C115 P56072 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 191649 T403 C115 P56072 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 191650 T403 C115 P56072 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 191652 T403 C115 P56072 oass.SolrIndexSearcher.<init> Opening Searcher@ea91be realtime
[junit4:junit4] 2> 191652 T403 C115 P56072 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 191652 T403 C115 P56072 oasup.LogUpdateProcessor.finish [collection1] webapp=/_xo/vn path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 191720 T461 C114 P56099 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 191720 T461 C114 P56099 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 191733 T461 C114 P56099 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 191738 T401 C115 P56072 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 191739 T401 C115 P56072 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 191740 T461 C114 P56099 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 191740 T461 C114 P56099 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 191741 T461 C114 P56099 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 191745 T402 C115 P56072 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 191745 T461 C114 P56099 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 191748 T461 C114 P56099 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index.20130616165909937
[junit4:junit4] 2> 191749 T461 C114 P56099 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index.20130616165909937 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d908c fullCopy=false
[junit4:junit4] 2> 191760 T406 C115 P56072 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=3
[junit4:junit4] 2> 191772 T461 C114 P56099 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 191778 T461 C114 P56099 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 191778 T461 C114 P56099 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 191786 T461 C114 P56099 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 191788 T461 C114 P56099 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 191788 T461 C114 P56099 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 191790 T461 C114 P56099 oass.SolrIndexSearcher.<init> Opening Searcher@128913a main
[junit4:junit4] 2> 191792 T460 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@128913a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 191792 T461 C114 P56099 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index.20130616165909937 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index.20130616165909937;done=true>>]
[junit4:junit4] 2> 191792 T461 C114 P56099 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index.20130616165909937
[junit4:junit4] 2> 191792 T461 C114 P56099 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty4\index.20130616165909937
[junit4:junit4] 2> 191798 T461 C114 P56099 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 191798 T461 C114 P56099 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 191798 T461 C114 P56099 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 191798 T461 C114 P56099 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 191802 T461 C114 P56099 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 191845 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 191846 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56099__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56099__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56099/_xo/vn"}
[junit4:junit4] 2> 191854 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191855 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191855 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191856 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191856 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191859 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 191859 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 192238 T476 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 192247 T476 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 192252 T476 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 192268 T476 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 192281 T476 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 192285 T476 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 192287 T476 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 192287 T476 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 192287 T476 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 192290 T476 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 192290 T476 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 192290 T476 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 192291 T476 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371391145975\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty5\
[junit4:junit4] 2> 192291 T476 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 192291 T476 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 192292 T476 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5
[junit4:junit4] 2> 192293 T476 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty5\index/
[junit4:junit4] 2> 192294 T476 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 192294 T476 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index
[junit4:junit4] 2> 192301 T476 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 192301 T476 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 192307 T476 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 192307 T476 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 192308 T476 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 192309 T476 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 192309 T476 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 192310 T476 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 192318 T476 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 192319 T476 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 192320 T476 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 192330 T476 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 192340 T476 oass.SolrIndexSearcher.<init> Opening Searcher@1478649 main
[junit4:junit4] 2> 192341 T476 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 192342 T476 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 192347 T479 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1478649 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 192349 T476 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 192349 T476 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56109/_xo/vn collection:collection1 shard:shard2
[junit4:junit4] 2> 192355 T476 oasc.ZkController.register We are http://127.0.0.1:56109/_xo/vn/collection1/ and leader is http://127.0.0.1:56081/_xo/vn/collection1/
[junit4:junit4] 2> 192355 T476 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56109/_xo/vn
[junit4:junit4] 2> 192355 T476 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 192355 T476 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C116 name=collection1 org.apache.solr.core.SolrCore@43918c url=http://127.0.0.1:56109/_xo/vn/collection1 node=127.0.0.1:56109__xo%2Fvn C116_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56109__xo%2Fvn, base_url=http://127.0.0.1:56109/_xo/vn}
[junit4:junit4] 2> 192356 T480 C116 P56109 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 192358 T476 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 192358 T480 C116 P56109 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 192358 T480 C116 P56109 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 192359 T480 C116 P56109 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 192360 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 192361 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 192361 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 192361 T480 C116 P56109 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 192371 T418 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56109__xo%2Fvn_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 192743 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 192749 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56122
[junit4:junit4] 2> 192749 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 192749 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 192751 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562
[junit4:junit4] 2> 192751 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562\solr.xml
[junit4:junit4] 2> 192752 T368 oasc.CoreContainer.<init> New CoreContainer 18363234
[junit4:junit4] 2> 192752 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562\'
[junit4:junit4] 2> 192753 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562\'
[junit4:junit4] 2> 192863 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 192863 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 192864 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 192864 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 192864 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 192865 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 192865 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 192867 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 192867 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 192867 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 192874 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 192875 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 192875 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 192877 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 192892 T492 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc07a4 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 192893 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 192897 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 192903 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 192906 T494 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@269b79 name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 192906 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 192914 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 193210 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 193212 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56109__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56109__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56109/_xo/vn"}
[junit4:junit4] 2> 193235 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193237 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193239 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193237 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193238 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193239 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193239 T494 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193239 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193262 T418 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56109__xo%2Fvn_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 193263 T418 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56109__xo%252Fvn_collection1&state=recovering&nodeName=127.0.0.1:56109__xo%252Fvn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=892
[junit4:junit4] 2> 193809 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56122__xo%2Fvn
[junit4:junit4] 2> 193812 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56122__xo%2Fvn
[junit4:junit4] 2> 193816 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193817 T397 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193817 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 193818 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193819 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193820 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 193822 T494 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193822 T494 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 193823 T442 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193824 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 193824 T426 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193824 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 193823 T475 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193828 T390 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193830 T410 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193831 T458 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 193840 T495 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 193840 T495 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 194599 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 194601 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56122__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56122/_xo/vn"}
[junit4:junit4] 2> 194602 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 194602 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 194625 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194628 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194630 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194631 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194628 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194628 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194632 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194632 T494 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 194734 T495 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562\collection1
[junit4:junit4] 2> 194734 T495 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 194736 T495 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 194736 T495 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 194742 T495 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562\collection1\'
[junit4:junit4] 2> 194745 T495 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 194746 T495 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562/collection1/lib/README' to classloader
[junit4:junit4] 2> 194814 T495 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 194880 T495 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 194883 T495 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 194888 T495 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C117 name=collection1 org.apache.solr.core.SolrCore@43918c url=http://127.0.0.1:56109/_xo/vn/collection1 node=127.0.0.1:56109__xo%2Fvn C117_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56109__xo%2Fvn, base_url=http://127.0.0.1:56109/_xo/vn}
[junit4:junit4] 2> 195046 T480 C117 P56109 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56081/_xo/vn/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 195046 T480 C117 P56109 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56109/_xo/vn START replicas=[http://127.0.0.1:56081/_xo/vn/collection1/] nUpdates=100
[junit4:junit4] 2> 195047 T480 C117 P56109 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 195047 T480 C117 P56109 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 195047 T480 C117 P56109 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 195047 T480 C117 P56109 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 195047 T480 C117 P56109 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 195047 T480 C117 P56109 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:56081/_xo/vn/collection1/. core=collection1
[junit4:junit4] 2> 195047 T480 C117 P56109 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C118 name=collection1 org.apache.solr.core.SolrCore@ed7b19 url=http://127.0.0.1:56081/_xo/vn/collection1 node=127.0.0.1:56081__xo%2Fvn C118_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56081__xo%2Fvn, base_url=http://127.0.0.1:56081/_xo/vn, leader=true}
[junit4:junit4] 2> 195070 T418 C118 P56081 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=6
[junit4:junit4] 2> 195071 T420 C118 P56081 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 195075 T420 C118 P56081 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 195077 T420 C118 P56081 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 195082 T420 C118 P56081 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 195082 T420 C118 P56081 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 195085 T420 C118 P56081 oass.SolrIndexSearcher.<init> Opening Searcher@8aeebf realtime
[junit4:junit4] 2> 195085 T420 C118 P56081 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 195085 T420 C118 P56081 oasup.LogUpdateProcessor.finish [collection1] webapp=/_xo/vn path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 195087 T480 C117 P56109 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 195087 T480 C117 P56109 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 195091 T422 C118 P56081 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 195091 T422 C118 P56081 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 195092 T480 C117 P56109 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 195092 T480 C117 P56109 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 195092 T480 C117 P56109 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 195130 T417 C118 P56081 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=36
[junit4:junit4] 2> 195132 T480 C117 P56109 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 195133 T480 C117 P56109 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index.20130616165913323
[junit4:junit4] 2> 195134 T480 C117 P56109 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.SimpleFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index.20130616165913323 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17bb637 fullCopy=false
[junit4:junit4] 2> 195140 T419 C118 P56081 oasc.SolrCore.execute [collection1] webapp=/_xo/vn path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 195141 T480 C117 P56109 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 195145 T480 C117 P56109 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 195145 T480 C117 P56109 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 195149 T480 C117 P56109 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 195151 T480 C117 P56109 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 195151 T480 C117 P56109 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 195152 T480 C117 P56109 oass.SolrIndexSearcher.<init> Opening Searcher@1f610a7 main
[junit4:junit4] 2> 195153 T479 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f610a7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 195154 T480 C117 P56109 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index.20130616165913323 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index.20130616165913323;done=true>>]
[junit4:junit4] 2> 195154 T480 C117 P56109 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index.20130616165913323
[junit4:junit4] 2> 195154 T480 C117 P56109 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty5\index.20130616165913323
[junit4:junit4] 2> 195155 T480 C117 P56109 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 195155 T480 C117 P56109 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 195155 T480 C117 P56109 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 195155 T480 C117 P56109 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 195159 T480 C117 P56109 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 195597 T495 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 195607 T495 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 195611 T495 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 195630 T495 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 195660 T495 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 195666 T495 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 195669 T495 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 195670 T495 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 195670 T495 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 195671 T495 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 195671 T495 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 195671 T495 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 195672 T495 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371391150562\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty6\
[junit4:junit4] 2> 195673 T495 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1149fda
[junit4:junit4] 2> 195673 T495 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 195674 T495 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty6
[junit4:junit4] 2> 195676 T495 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359/jetty6\index/
[junit4:junit4] 2> 195677 T495 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty6\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 195677 T495 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty6\index
[junit4:junit4] 2> 195689 T495 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty6\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 195689 T495 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 195691 T495 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 195691 T495 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 195692 T495 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 195693 T495 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 195693 T495 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 195693 T495 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 195699 T495 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 195700 T495 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 195700 T495 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 195711 T495 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 195720 T495 oass.SolrIndexSearcher.<init> Opening Searcher@6afe93 main
[junit4:junit4] 2> 195722 T495 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 195722 T495 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 195729 T498 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6afe93 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 195730 T495 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 195730 T495 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56122/_xo/vn collection:collection1 shard:shard3
[junit4:junit4] 2> 195737 T495 oasc.ZkController.register We are http://127.0.0.1:56122/_xo/vn/collection1/ and leader is http://127.0.0.1:56090/_xo/vn/collection1/
[junit4:junit4] 2> 195737 T495 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56122/_xo/vn
[junit4:junit4] 2> 195737 T495 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 195737 T495 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C119 name=collection1 org.apache.solr.core.SolrCore@c37ab2 url=http://127.0.0.1:56122/_xo/vn/collection1 node=127.0.0.1:56122__xo%2Fvn C119_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56122__xo%2Fvn, base_url=http://127.0.0.1:56122/_xo/vn}
[junit4:junit4] 2> 195738 T499 C119 P56122 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 195738 T499 C119 P56122 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 195739 T499 C119 P56122 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 195739 T499 C119 P56122 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 195740 T495 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 195741 T499 C119 P56122 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 195744 T368 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 195744 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 195744 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 195750 T437 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56122__xo%2Fvn_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 195985 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 195985 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56109__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56109__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56109/_xo/vn"}
[junit4:junit4] 2> 196002 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56122__xo%2Fvn_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56122__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56122/_xo/vn"}
[junit4:junit4] 2> 196012 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196013 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196013 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196013 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196014 T494 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196014 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196015 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196015 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 196145 T368 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 196152 T368 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56135
[junit4:junit4] 2> 196155 T368 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 196156 T368 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 196156 T368 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371391153941
[junit4:junit4] 2> 196157 T368 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371391153941\solr.xml
[junit4:junit4] 2> 196157 T368 oasc.CoreContainer.<init> New CoreContainer 9920797
[junit4:junit4] 2> 196158 T368 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371391153941\'
[junit4:junit4] 2> 196158 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371391153941\'
[junit4:junit4] 2> 196304 T368 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 196305 T368 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 196305 T368 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 196306 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 196306 T368 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 196306 T368 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 196306 T368 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 196306 T368 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 196307 T368 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 196308 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 196316 T368 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 196317 T368 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56053/solr
[junit4:junit4] 2> 196318 T368 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 196320 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 196328 T511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b1989 name:ZooKeeperConnection Watcher:127.0.0.1:56053 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 196329 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 196333 T368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 196340 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 196345 T513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15397cb name:ZooKeeperConnection Watcher:127.0.0.1:56053/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 196346 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 196355 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 196642 T437 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56122__xo%2Fvn_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 196643 T437 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56122__xo%252Fvn_collection1&state=recovering&nodeName=127.0.0.1:56122__xo%252Fvn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=893
[junit4:junit4] 2> 197251 T368 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56135__xo%2Fvn
[junit4:junit4] 2> 197257 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56135__xo%2Fvn
[junit4:junit4] 2> 197265 T475 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 197270 T458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 197272 T390 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 197273 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 197277 T397 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197278 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197281 T513 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197283 T494 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197283 T494 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197286 T426 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197286 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197284 T442 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197289 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197291 T410 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197291 T458 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197293 T390 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197293 T475 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 197303 T514 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 197303 T514 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 197370 T391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 197371 T391 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56135__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56135/_xo/vn"}
[junit4:junit4] 2> 197372 T391 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 197372 T391 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 197390 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197392 T410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197393 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 197393 T494 oascc.ZkStateReader$2.process A cluster state change: Watch
[...truncated too long message...]
,
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56181__xo%2Fvn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56181/_xo/vn"}
[junit4:junit4] 2> 466458 T368 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 56192
[junit4:junit4] 2> 466459 T368 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=29070089
[junit4:junit4] 2> 466463 T608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 467327 T368 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 467327 T368 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 467330 T368 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@18c302
[junit4:junit4] 2> 467332 T368 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=22,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1117,cumulative_deletesById=539,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 467333 T368 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 467333 T368 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 467333 T368 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 467337 T368 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 467337 T368 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 467338 T368 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty12 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty12;done=false>>]
[junit4:junit4] 2> 467338 T368 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty12
[junit4:junit4] 2> 467338 T368 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty12\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty12\index;done=false>>]
[junit4:junit4] 2> 467339 T368 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\jetty12\index
[junit4:junit4] 2> 467341 T894 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89875488202489884-127.0.0.1:56192__xo%2Fvn-n_0000000012) am no longer a leader.
[junit4:junit4] 2> 467355 T368 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_xo/vn,null}
[junit4:junit4] 2> 467514 T589 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 467514 T589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 467514 T589 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\zookeeper\server1\data\version-2\log.1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\zookeeper\server1\data\version-2 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\zookeeper\server1\data FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\zookeeper\server1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359\zookeeper FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371391116359 FAILED !!!!!
[junit4:junit4] 2> 467755 T368 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 467759 T368 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56053 56053
[junit4:junit4] 2> 468468 T608 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 469707 T608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 469708 T608 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.method=testDistribSearch -Dtests.seed=473B937C701732D2 -Dtests.slow=true -Dtests.locale=zh_TW -Dtests.timezone=Israel -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 312s | ChaosMonkeySafeLeaderTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard3 is not consistent. Got 582 from http://127.0.0.1:56159/_xo/vn/collection1lastClient and got 578 from http://127.0.0.1:56192/_xo/vn/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([473B937C701732D2:C6DD1D64074852EE]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 469770 T368 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=zh_TW, timezone=Israel
[junit4:junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_21 (32-bit)/cpus=2,threads=1,free=65910104,total=213909504
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestRTGBase, TestSchemaSimilarityResource, SpellCheckComponentTest, TestSurroundQueryParser, TestExtendedDismaxParser, TestLuceneMatchVersion, TestRecovery, TestDefaultSimilarityFactory, NotRequiredUniqueKeyTest, SchemaVersionSpecificBehaviorTest, SliceStateUpdateTest, URLClassifyProcessorTest, TestPartialUpdateDeduplication, XsltUpdateRequestHandlerTest, TestZkChroot, DistanceFunctionTest, ClusterStateTest, TestSolrXMLSerializer, OverseerCollectionProcessorTest, DistributedTermsComponentTest, TestPHPSerializedResponseWriter, TestCollationField, TestJoin, IndexReaderFactoryTest, TestSolrIndexConfig, DateFieldTest, TestPerFieldSimilarity, TestAtomicUpdateErrorCases, TestPluginEnable, TestBM25SimilarityFactory, ChaosMonkeySafeLeaderTest]
[junit4:junit4] Completed in 311.68s, 1 test, 1 failure <<< FAILURES!
[...truncated 831 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 failure, 18 ignored (12 assumptions)
Total time: 74 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure