You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/07 03:16:04 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_05) - Build # 4014 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4014/
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch

Error Message:
Control does not match cloud expected:<392> but was:<329>

Stack Trace:
java.lang.AssertionError: Control does not match cloud expected:<392> but was:<329>
	at __randomizedtesting.SeedInfo.seed([7EB301D397A52785:FF558FCBE0FA47B9]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:417)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10905 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\init-core-data-001
   [junit4]   2> 326763 T1010 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 326765 T1010 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 326767 T1010 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 326768 T1011 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 326857 T1010 oasc.ZkTestServer.run start zk server on port:49739
   [junit4]   2> 326858 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 326864 T1017 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fd9be60 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 326865 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 326865 T1010 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 326872 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 326875 T1019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cf81f31 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 326875 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 326875 T1010 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 326878 T1010 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 326881 T1010 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 326883 T1010 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 326885 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 326885 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 326891 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 326891 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 326894 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 326894 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 326898 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 326898 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 326900 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 326900 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 326903 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 326903 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 326906 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 326907 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 326910 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 326910 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 326912 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 326912 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 326917 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 326917 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 326921 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 326921 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 328330 T1010 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 328365 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49746
   [junit4]   2> 328366 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 328366 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 328366 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002
   [junit4]   2> 328366 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\'
   [junit4]   2> 328397 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\solr.xml
   [junit4]   2> 328412 T1010 oasc.CoreContainer.<init> New CoreContainer 883734489
   [junit4]   2> 328413 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\]
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 328416 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 328416 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 328416 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 328416 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 328418 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr
   [junit4]   2> 328418 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 328418 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 328438 T1032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af22b98 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 328438 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 328450 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 328455 T1034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24b63c8b name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 328455 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 328458 T1010 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 328462 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 328465 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 328472 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 328477 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 328481 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 328483 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49746_
   [junit4]   2> 328484 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49746_
   [junit4]   2> 328488 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 328491 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 328499 T1010 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49746_
   [junit4]   2> 328499 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 328502 T1010 oasc.Overseer.start Overseer (id=91712536490541059-127.0.0.1:49746_-n_0000000000) starting
   [junit4]   2> 328508 T1010 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 328532 T1036 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 328532 T1010 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 328532 T1036 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:49746_
   [junit4]   2> 328535 T1010 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 328538 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 328541 T1035 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 328546 T1037 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 328546 T1037 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 328547 T1037 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 328547 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 328549 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 328550 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49746",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49746_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 328550 T1035 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 328550 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 328553 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 328554 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 329438 T1037 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 329438 T1037 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 329440 T1037 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 329440 T1037 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 329442 T1037 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 329442 T1037 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\collection1\'
   [junit4]   2> 329444 T1037 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 329445 T1037 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 329446 T1037 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 329480 T1037 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 329490 T1037 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 329492 T1037 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 329497 T1037 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 329606 T1037 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 329608 T1037 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 329610 T1037 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 329614 T1037 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 329642 T1037 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 329642 T1037 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 329643 T1037 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\collection1\, dataDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\
   [junit4]   2> 329643 T1037 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3087c433
   [junit4]   2> 329644 T1037 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\
   [junit4]   2> 329644 T1037 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\index/
   [junit4]   2> 329644 T1037 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 329644 T1037 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\index
   [junit4]   2> 329644 T1037 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6407478258937532]
   [junit4]   2> 329645 T1037 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3c4d480b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f3e9dca),segFN=segments_1,generation=1}
   [junit4]   2> 329645 T1037 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 329648 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 329649 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 329649 T1037 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 329649 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 329650 T1037 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 329650 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 329650 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 329651 T1037 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 329651 T1037 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 329652 T1037 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 329652 T1037 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 329652 T1037 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 329653 T1037 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 329658 T1037 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 329662 T1037 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 329662 T1037 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 329663 T1037 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=66.6376953125, floorSegmentMB=0.578125, forceMergeDeletesPctAllowed=18.561335697448744, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7539073758598878
   [junit4]   2> 329663 T1037 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3c4d480b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f3e9dca),segFN=segments_1,generation=1}
   [junit4]   2> 329663 T1037 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 329664 T1037 oass.SolrIndexSearcher.<init> Opening Searcher@38f2fb2[collection1] main
   [junit4]   2> 329664 T1037 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 329665 T1037 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 329665 T1037 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 329665 T1037 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 329665 T1037 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 329665 T1037 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 329667 T1037 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 329667 T1037 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 329667 T1037 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 329667 T1037 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 329670 T1037 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 329670 T1038 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38f2fb2[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 329672 T1010 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 329672 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 329676 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 329678 T1041 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49746 collection:control_collection shard:shard1
   [junit4]   2> 329689 T1043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57338ecd name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 329689 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 329690 T1041 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 329692 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 329699 T1010 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 329826 T1041 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 329830 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329831 T1041 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 329831 T1041 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C400 name=collection1 org.apache.solr.core.SolrCore@2a373f1c url=http://127.0.0.1:49746/collection1 node=127.0.0.1:49746_ C400_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:49746, core=collection1, node_name=127.0.0.1:49746_}
   [junit4]   2> 329831 T1041 C400 P49746 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49746/collection1/
   [junit4]   2> 329831 T1041 C400 P49746 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 329831 T1041 C400 P49746 oasc.SyncStrategy.syncToMe http://127.0.0.1:49746/collection1/ has no replicas
   [junit4]   2> 329831 T1041 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49746/collection1/ shard1
   [junit4]   2> 329832 T1041 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 329834 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 329842 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329846 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329875 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329968 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 329968 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 329983 T1041 oasc.ZkController.register We are http://127.0.0.1:49746/collection1/ and leader is http://127.0.0.1:49746/collection1/
   [junit4]   2> 329983 T1041 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49746
   [junit4]   2> 329983 T1041 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 329983 T1041 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 329983 T1041 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 329985 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329985 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329985 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 329987 T1041 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 329989 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 329990 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49746",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49746_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 329994 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 330087 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 330087 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331322 T1010 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 331323 T1010 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 331328 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49758
   [junit4]   2> 331328 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 331328 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 331329 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003
   [junit4]   2> 331329 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\'
   [junit4]   2> 331354 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\solr.xml
   [junit4]   2> 331376 T1010 oasc.CoreContainer.<init> New CoreContainer 1787614664
   [junit4]   2> 331377 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\]
   [junit4]   2> 331378 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 331378 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 331379 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 331379 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 331379 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 331380 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 331380 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 331380 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 331381 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 331381 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 331381 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 331382 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 331382 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr
   [junit4]   2> 331382 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 331385 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 331408 T1054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b42f06 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 331408 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 331418 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 331423 T1056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d785cb5 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 331423 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 331439 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 332356 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49758_
   [junit4]   2> 332362 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49758_
   [junit4]   2> 332389 T1057 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 332389 T1057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 332393 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332393 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332394 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332393 T1057 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 332399 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 332401 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49758",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49758_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 332401 T1035 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 332402 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 332411 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332414 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 332415 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 332415 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 333374 T1057 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 333374 T1057 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 333376 T1057 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 333376 T1057 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 333380 T1057 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 333380 T1057 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\collection1\'
   [junit4]   2> 333385 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 333385 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 333388 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 333444 T1057 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 333459 T1057 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 333463 T1057 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 333469 T1057 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 333584 T1057 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 333588 T1057 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 333588 T1057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 333595 T1057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 333624 T1057 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 333624 T1057 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 333625 T1057 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\collection1\, dataDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\
   [junit4]   2> 333625 T1057 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3087c433
   [junit4]   2> 333625 T1057 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\
   [junit4]   2> 333625 T1057 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\index/
   [junit4]   2> 333625 T1057 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 333627 T1057 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\index
   [junit4]   2> 333627 T1057 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6407478258937532]
   [junit4]   2> 333627 T1057 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@30903c65 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f0760cc),segFN=segments_1,generation=1}
   [junit4]   2> 333627 T1057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 333630 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 333630 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 333630 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 333630 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 333631 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 333631 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 333631 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 333633 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 333633 T1057 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 333636 T1057 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 333636 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 333636 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 333637 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 333642 T1057 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 333644 T1057 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 333644 T1057 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 333646 T1057 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=66.6376953125, floorSegmentMB=0.578125, forceMergeDeletesPctAllowed=18.561335697448744, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7539073758598878
   [junit4]   2> 333646 T1057 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@30903c65 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f0760cc),segFN=segments_1,generation=1}
   [junit4]   2> 333646 T1057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 333647 T1057 oass.SolrIndexSearcher.<init> Opening Searcher@2084a7f7[collection1] main
   [junit4]   2> 333647 T1057 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 333648 T1057 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 333648 T1057 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 333649 T1057 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 333649 T1057 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 333649 T1057 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 333650 T1057 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 333650 T1057 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 333650 T1057 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 333650 T1057 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 333654 T1057 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 333654 T1058 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2084a7f7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 333657 T1061 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49758 collection:collection1 shard:shard2
   [junit4]   2> 333658 T1010 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 333658 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 333669 T1061 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 333935 T1061 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 333938 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 333939 T1061 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 333939 T1061 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C401 name=collection1 org.apache.solr.core.SolrCore@2a105534 url=http://127.0.0.1:49758/collection1 node=127.0.0.1:49758_ C401_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:49758, core=collection1, node_name=127.0.0.1:49758_}
   [junit4]   2> 333939 T1061 C401 P49758 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49758/collection1/
   [junit4]   2> 333939 T1061 C401 P49758 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 333939 T1061 C401 P49758 oasc.SyncStrategy.syncToMe http://127.0.0.1:49758/collection1/ has no replicas
   [junit4]   2> 333939 T1061 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49758/collection1/ shard2
   [junit4]   2> 333941 T1061 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 333942 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 333949 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 333952 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 333952 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 333952 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 333960 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 333964 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 334067 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 334068 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 334068 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 334106 T1061 oasc.ZkController.register We are http://127.0.0.1:49758/collection1/ and leader is http://127.0.0.1:49758/collection1/
   [junit4]   2> 334106 T1061 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49758
   [junit4]   2> 334106 T1061 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 334106 T1061 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 334106 T1061 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 334109 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 334109 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 334109 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 334111 T1061 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 334113 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 334113 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49758",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49758_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 334118 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 334222 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 334222 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 334222 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335443 T1010 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 335444 T1010 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 335462 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49767
   [junit4]   2> 335465 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 335466 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 335467 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004
   [junit4]   2> 335467 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\'
   [junit4]   2> 335496 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\solr.xml
   [junit4]   2> 335512 T1010 oasc.CoreContainer.<init> New CoreContainer 1050527731
   [junit4]   2> 335513 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\]
   [junit4]   2> 335514 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 335514 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 335515 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 335516 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 335516 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 335518 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 335518 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 335519 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 335520 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 335521 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 335521 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 335522 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 335523 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr
   [junit4]   2> 335523 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 335526 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 335547 T1072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a446b0 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 335547 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 335558 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 335561 T1074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b34a302 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 335561 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 335581 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 336568 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49767_
   [junit4]   2> 336572 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49767_
   [junit4]   2> 336601 T1075 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 336601 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 336605 T1075 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 336606 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336606 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336606 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336611 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 336613 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49767",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49767_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 336614 T1035 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 336614 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 336624 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336628 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 336628 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 336629 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 336628 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 337586 T1075 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 337586 T1075 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 337588 T1075 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 337588 T1075 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 337592 T1075 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 337592 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\collection1\'
   [junit4]   2> 337601 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 337601 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 337601 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 337650 T1075 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 337664 T1075 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 337675 T1075 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 337684 T1075 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 337806 T1075 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 337809 T1075 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 337809 T1075 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 337814 T1075 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 337856 T1075 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 337856 T1075 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 337856 T1075 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\collection1\, dataDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\
   [junit4]   2> 337856 T1075 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3087c433
   [junit4]   2> 337857 T1075 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\
   [junit4]   2> 337857 T1075 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\index/
   [junit4]   2> 337857 T1075 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 337857 T1075 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\index
   [junit4]   2> 337858 T1075 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6407478258937532]
   [junit4]   2> 337859 T1075 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2428f4ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e27d298),segFN=segments_1,generation=1}
   [junit4]   2> 337859 T1075 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 337863 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 337863 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 337864 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 337864 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 337864 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 337864 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 337865 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 337865 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 337865 T1075 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 337872 T1075 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 337879 T1075 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 337879 T1075 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 337881 T1075 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=66.6376953125, floorSegmentMB=0.578125, forceMergeDeletesPctAllowed=18.561335697448744, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7539073758598878
   [junit4]   2> 337881 T1075 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2428f4ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e27d298),segFN=segments_1,generation=1}
   [junit4]   2> 337882 T1075 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 337882 T1075 oass.SolrIndexSearcher.<init> Opening Searcher@6e1b9a95[collection1] main
   [junit4]   2> 337882 T1075 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 337884 T1075 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 337884 T1075 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 337886 T1075 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 337886 T1075 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 337886 T1075 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 337887 T1075 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 337887 T1075 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 337887 T1075 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 337888 T1075 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 337890 T1076 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e1b9a95[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 337891 T1075 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 337892 T1079 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49767 collection:collection1 shard:shard3
   [junit4]   2> 337893 T1010 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 337893 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 337896 T1079 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 337909 T1079 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 337913 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 337914 T1079 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 337914 T1079 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C402 name=collection1 org.apache.solr.core.SolrCore@12e876c1 url=http://127.0.0.1:49767/collection1 node=127.0.0.1:49767_ C402_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:49767, core=collection1, node_name=127.0.0.1:49767_}
   [junit4]   2> 337915 T1079 C402 P49767 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49767/collection1/
   [junit4]   2> 337915 T1079 C402 P49767 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 337915 T1079 C402 P49767 oasc.SyncStrategy.syncToMe http://127.0.0.1:49767/collection1/ has no replicas
   [junit4]   2> 337915 T1079 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49767/collection1/ shard3
   [junit4]   2> 337916 T1079 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 337917 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 337927 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 337932 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 337938 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338040 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338040 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338041 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338042 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338084 T1079 oasc.ZkController.register We are http://127.0.0.1:49767/collection1/ and leader is http://127.0.0.1:49767/collection1/
   [junit4]   2> 338084 T1079 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49767
   [junit4]   2> 338084 T1079 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 338084 T1079 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 338084 T1079 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 338087 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338087 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338087 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338089 T1079 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 338091 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 338091 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49767",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49767_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 338100 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338203 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338203 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338203 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 338203 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 339683 T1010 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 339683 T1010 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 339687 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49776
   [junit4]   2> 339688 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 339690 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 339690 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005
   [junit4]   2> 339690 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\'
   [junit4]   2> 339725 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\solr.xml
   [junit4]   2> 339744 T1010 oasc.CoreContainer.<init> New CoreContainer 1139840461
   [junit4]   2> 339744 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\]
   [junit4]   2> 339745 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 339746 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 339746 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 339750 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 339750 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr
   [junit4]   2> 339750 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 339753 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 339788 T1092 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37a87021 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 339789 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 339801 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 339806 T1094 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72257366 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 339806 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 339825 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 340810 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49776_
   [junit4]   2> 340815 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49776_
   [junit4]   2> 340851 T1095 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 340852 T1095 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 340858 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 340858 T1095 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 340858 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 340860 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 340866 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 340868 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49776",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49776_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 340868 T1035 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 340869 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 340880 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 340884 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 340885 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 340886 T1094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 340886 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 340886 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 341839 T1095 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 341839 T1095 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 341840 T1095 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 341841 T1095 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 341844 T1095 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 341845 T1095 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\collection1\'
   [junit4]   2> 341852 T1095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-005/collection1/lib/.svn/' to classloader
   [junit4]   2> 341855 T1095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-005/collection1/lib/classes/' to classloader
   [junit4]   2> 341857 T1095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-005/collection1/lib/REA

[...truncated too long message...]

chChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 437803 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 437804 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 437804 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 437804 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.method=testDistribSearch -Dtests.seed=7EB301D397A52785 -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=Iceland -Dtests.file.encoding=Cp1252
   [junit4] FAILURE  111s | FullSolrCloudDistribCmdsTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Control does not match cloud expected:<392> but was:<329>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7EB301D397A52785:FF558FCBE0FA47B9]:0)
   [junit4]    > 	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:417)
   [junit4]    > 	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 437813 T1010 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 437820 T1360 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=64,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=9764,transaction_logs_total_number=1}
   [junit4]   2> 437820 T1360 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 437820 T1360 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 437820 T1360 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 437823 T1360 oasc.SolrCore.closeSearcher [collection2_shard2_replica2] Closing main searcher on request.
   [junit4]   2> 437823 T1360 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 437823 T1360 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\ [CachedDir<<refCount=0;path=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\;done=false>>]
   [junit4]   2> 437823 T1360 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\
   [junit4]   2> 437823 T1360 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\index [CachedDir<<refCount=0;path=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\index;done=false>>]
   [junit4]   2> 437823 T1360 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\index
   [junit4]   2> 437823 T1360 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard4/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 437823 T1360 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 437823 T1360 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=lv_LV, timezone=Iceland
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=2,threads=1,free=58199376,total=142868480
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudInspectUtil, PrimUtilsTest, TestMultiCoreConfBootstrap, HdfsWriteToMultipleCollectionsTest, ZkSolrClientTest, HighlighterConfigTest, TestSolrJ, DocumentBuilderTest, StatelessScriptUpdateProcessorFactoryTest, FileBasedSpellCheckerTest, TestClassNameShortening, WordBreakSolrSpellCheckerTest, ConvertedLegacyTest, ChaosMonkeyNothingIsSafeTest, SolrCoreCheckLockOnStartupTest, UnloadDistributedZkTest, TestRangeQuery, ModifyConfFileTest, BadCopyFieldTest, ResponseLogComponentTest, RAMDirectoryFactoryTest, DistributedExpandComponentTest, SolrRequestParserTest, TestJoin, DirectSolrSpellCheckerTest, TestImplicitCoreProperties, QueryEqualityTest, QueryResultKeyTest, TestDFRSimilarityFactory, SolrIndexSplitterTest, TestStressRecovery, BasicZkTest, TestSearchPerf, CircularListTest, TestSolrXmlPersistence, LoggingHandlerTest, QueryParsingTest, DistributedQueryElevationComponentTest, TestRecovery, TestArbitraryIndexDir, TestStressUserVersions, TestSearcherReuse, TestManagedResourceStorage, TestCharFilters, FullSolrCloudDistribCmdsTest]
   [junit4] Completed in 111.98s, 1 test, 1 failure <<< FAILURES!

[...truncated 1087 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1296: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:920: There were test failures: 398 suites, 1673 tests, 1 failure, 42 ignored (21 assumptions)

Total time: 87 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_05) - Build # 4014 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
Newish fail. Ugly.

-- 
Mark Miller
about.me/markrmiller

On May 7, 2014 at 1:09:35 PM, Policeman Jenkins Server (jenkins@thetaphi.de) wrote:

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4014/  
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC  

1 tests failed.  
REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch  

Error Message:  
Control does not match cloud expected:<392> but was:<329>  

Stack Trace:  
java.lang.AssertionError: Control does not match cloud expected:<392> but was:<329>  
at __randomizedtesting.SeedInfo.seed([7EB301D397A52785:FF558FCBE0FA47B9]:0)  
at org.junit.Assert.fail(Assert.java:93)  
at org.junit.Assert.failNotEquals(Assert.java:647)  
at org.junit.Assert.assertEquals(Assert.java:128)  
at org.junit.Assert.assertEquals(Assert.java:472)  
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:417)  
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)  
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.lang.reflect.Method.invoke(Method.java:483)  
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)  
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)  
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)  
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)  
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)  
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)  
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)  
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)  
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)  
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)  
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)  
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)  
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)  
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)  
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)  
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)  
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)  
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)  
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)  
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)  
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)  
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)  
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)  
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)  
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)  
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)  
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)  
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)  
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)  
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)  
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)  
at java.lang.Thread.run(Thread.java:745)  




Build Log:  
[...truncated 10905 lines...]  
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest  
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\init-core-data-001  
[junit4] 2> 326763 T1010 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /  
[junit4] 2> 326765 T1010 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch  
[junit4] 2> 326767 T1010 oasc.ZkTestServer.run STARTING ZK TEST SERVER  
[junit4] 1> client port:0.0.0.0/0.0.0.0:0  
[junit4] 2> 326768 T1011 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server  
[junit4] 2> 326857 T1010 oasc.ZkTestServer.run start zk server on port:49739  
[junit4] 2> 326858 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 326864 T1017 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fd9be60 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 326865 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 326865 T1010 oascc.SolrZkClient.makePath makePath: /solr  
[junit4] 2> 326872 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 326875 T1019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cf81f31 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 326875 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 326875 T1010 oascc.SolrZkClient.makePath makePath: /collections/collection1  
[junit4] 2> 326878 T1010 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards  
[junit4] 2> 326881 T1010 oascc.SolrZkClient.makePath makePath: /collections/control_collection  
[junit4] 2> 326883 T1010 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards  
[junit4] 2> 326885 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml  
[junit4] 2> 326885 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml  
[junit4] 2> 326891 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml  
[junit4] 2> 326891 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml  
[junit4] 2> 326894 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml  
[junit4] 2> 326894 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml  
[junit4] 2> 326898 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt  
[junit4] 2> 326898 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt  
[junit4] 2> 326900 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt  
[junit4] 2> 326900 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt  
[junit4] 2> 326903 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml  
[junit4] 2> 326903 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml  
[junit4] 2> 326906 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml  
[junit4] 2> 326907 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml  
[junit4] 2> 326910 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json  
[junit4] 2> 326910 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json  
[junit4] 2> 326912 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt  
[junit4] 2> 326912 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt  
[junit4] 2> 326917 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt  
[junit4] 2> 326917 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt  
[junit4] 2> 326921 T1010 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt  
[junit4] 2> 326921 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt  
[junit4] 2> 328330 T1010 oejs.Server.doStart jetty-8.1.10.v20130312  
[junit4] 2> 328365 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49746  
[junit4] 2> 328366 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  
[junit4] 2> 328366 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)  
[junit4] 2> 328366 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002  
[junit4] 2> 328366 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\'  
[junit4] 2> 328397 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\solr.xml  
[junit4] 2> 328412 T1010 oasc.CoreContainer.<init> New CoreContainer 883734489  
[junit4] 2> 328413 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\]  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5  
[junit4] 2> 328414 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  
[junit4] 2> 328416 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false  
[junit4] 2> 328416 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory  
[junit4] 2> 328416 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]  
[junit4] 2> 328416 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1  
[junit4] 2> 328418 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr  
[junit4] 2> 328418 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot  
[junit4] 2> 328418 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 328438 T1032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af22b98 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 328438 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 328450 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 328455 T1034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24b63c8b name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 328455 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 328458 T1010 oascc.SolrZkClient.makePath makePath: /overseer/queue  
[junit4] 2> 328462 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work  
[junit4] 2> 328465 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running  
[junit4] 2> 328472 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed  
[junit4] 2> 328477 T1010 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure  
[junit4] 2> 328481 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes  
[junit4] 2> 328483 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49746_  
[junit4] 2> 328484 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49746_  
[junit4] 2> 328488 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect  
[junit4] 2> 328491 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect/election  
[junit4] 2> 328499 T1010 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49746_  
[junit4] 2> 328499 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader  
[junit4] 2> 328502 T1010 oasc.Overseer.start Overseer (id=91712536490541059-127.0.0.1:49746_-n_0000000000) starting  
[junit4] 2> 328508 T1010 oascc.SolrZkClient.makePath makePath: /overseer/queue-work  
[junit4] 2> 328532 T1036 oasc.OverseerCollectionProcessor.run Process current queue of collection creations  
[junit4] 2> 328532 T1010 oascc.SolrZkClient.makePath makePath: /clusterstate.json  
[junit4] 2> 328532 T1036 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:49746_  
[junit4] 2> 328535 T1010 oascc.SolrZkClient.makePath makePath: /aliases.json  
[junit4] 2> 328538 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...  
[junit4] 2> 328541 T1035 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue  
[junit4] 2> 328546 T1037 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection  
[junit4] 2> 328546 T1037 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 328547 T1037 oasc.ZkController.waitForCoreNodeName look for our core node name  
[junit4] 2> 328547 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 328549 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 328550 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"down",  
[junit4] 2> "base_url":"http://127.0.0.1:49746",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49746_",  
[junit4] 2> "shard":null,  
[junit4] 2> "collection":"control_collection",  
[junit4] 2> "numShards":"1",  
[junit4] 2> "core_node_name":null}  
[junit4] 2> 328550 T1035 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]  
[junit4] 2> 328550 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1  
[junit4] 2> 328553 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 328554 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  
[junit4] 2> 329438 T1037 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1  
[junit4] 2> 329438 T1037 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection  
[junit4] 2> 329440 T1037 oasc.ZkController.createCollectionZkNode Collection zkNode exists  
[junit4] 2> 329440 T1037 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection  
[junit4] 2> 329442 T1037 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 329442 T1037 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\collection1\'  
[junit4] 2> 329444 T1037 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-002/collection1/lib/.svn/' to classloader  
[junit4] 2> 329445 T1037 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-002/collection1/lib/classes/' to classloader  
[junit4] 2> 329446 T1037 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-002/collection1/lib/README' to classloader  
[junit4] 2> 329480 T1037 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0  
[junit4] 2> 329490 T1037 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml  
[junit4] 2> 329492 T1037 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml  
[junit4] 2> 329497 T1037 oass.IndexSchema.readSchema [collection1] Schema name=test  
[junit4] 2> 329606 T1037 oass.IndexSchema.readSchema default search field in schema is text  
[junit4] 2> 329608 T1037 oass.IndexSchema.readSchema unique key field: id  
[junit4] 2> 329610 T1037 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml  
[junit4] 2> 329614 T1037 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml  
[junit4] 2> 329642 T1037 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection  
[junit4] 2> 329642 T1037 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory  
[junit4] 2> 329643 T1037 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-002\collection1\, dataDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\  
[junit4] 2> 329643 T1037 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3087c433  
[junit4] 2> 329644 T1037 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\  
[junit4] 2> 329644 T1037 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\index/  
[junit4] 2> 329644 T1037 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001\control\data\index' doesn't exist. Creating new index...  
[junit4] 2> 329644 T1037 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/control/data\index  
[junit4] 2> 329644 T1037 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6407478258937532]  
[junit4] 2> 329645 T1037 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1  
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3c4d480b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f3e9dca),segFN=segments_1,generation=1}  
[junit4] 2> 329645 T1037 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1  
[junit4] 2> 329648 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"  
[junit4] 2> 329649 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"  
[junit4] 2> 329649 T1037 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"  
[junit4] 2> 329649 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"  
[junit4] 2> 329650 T1037 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"  
[junit4] 2> 329650 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"  
[junit4] 2> 329650 T1037 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"  
[junit4] 2> 329651 T1037 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"  
[junit4] 2> 329651 T1037 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default  
[junit4] 2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler  
[junit4] 2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler  
[junit4] 2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler  
[junit4] 2> 329651 T1037 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler  
[junit4] 2> 329652 T1037 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler  
[junit4] 2> 329652 T1037 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers  
[junit4] 2> 329652 T1037 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler  
[junit4] 2> 329653 T1037 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler  
[junit4] 2> 329658 T1037 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60  
[junit4] 2> 329662 T1037 oasu.CommitTracker.<init> Hard AutoCommit: disabled  
[junit4] 2> 329662 T1037 oasu.CommitTracker.<init> Soft AutoCommit: disabled  
[junit4] 2> 329663 T1037 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=66.6376953125, floorSegmentMB=0.578125, forceMergeDeletesPctAllowed=18.561335697448744, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7539073758598878  
[junit4] 2> 329663 T1037 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1  
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3c4d480b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f3e9dca),segFN=segments_1,generation=1}  
[junit4] 2> 329663 T1037 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1  
[junit4] 2> 329664 T1037 oass.SolrIndexSearcher.<init> Opening Searcher@38f2fb2[collection1] main  
[junit4] 2> 329664 T1037 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection  
[junit4] 2> 329665 T1037 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 329665 T1037 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1  
[junit4] 2> 329665 T1037 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1  
[junit4] 2> 329665 T1037 oasr.RestManager.init Initializing RestManager with initArgs: {}  
[junit4] 2> 329665 T1037 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1  
[junit4] 2> 329667 T1037 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json  
[junit4] 2> 329667 T1037 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1  
[junit4] 2> 329667 T1037 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed  
[junit4] 2> 329667 T1037 oasr.RestManager.init Initializing 0 registered ManagedResources  
[junit4] 2> 329670 T1037 oasc.CoreContainer.registerCore registering core: collection1  
[junit4] 2> 329670 T1038 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38f2fb2[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}  
[junit4] 2> 329672 T1010 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0  
[junit4] 2> 329672 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done  
[junit4] 2> 329676 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 329678 T1041 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49746 collection:control_collection shard:shard1  
[junit4] 2> 329689 T1043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57338ecd name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 329689 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 329690 T1041 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election  
[junit4] 2> 329692 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...  
[junit4] 2> 329699 T1010 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false  
[junit4] 2> 329826 T1041 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1  
[junit4] 2> 329830 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329831 T1041 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.  
[junit4] 2> 329831 T1041 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync  
[junit4] 2> ASYNC NEW_CORE C400 name=collection1 org.apache.solr.core.SolrCore@2a373f1c url=http://127.0.0.1:49746/collection1 node=127.0.0.1:49746_ C400_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:49746, core=collection1, node_name=127.0.0.1:49746_}  
[junit4] 2> 329831 T1041 C400 P49746 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49746/collection1/  
[junit4] 2> 329831 T1041 C400 P49746 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me  
[junit4] 2> 329831 T1041 C400 P49746 oasc.SyncStrategy.syncToMe http://127.0.0.1:49746/collection1/ has no replicas  
[junit4] 2> 329831 T1041 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49746/collection1/ shard1  
[junit4] 2> 329832 T1041 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1  
[junit4] 2> 329834 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 329842 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329846 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329875 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329968 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  
[junit4] 2> 329968 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  
[junit4] 2> 329983 T1041 oasc.ZkController.register We are http://127.0.0.1:49746/collection1/ and leader is http://127.0.0.1:49746/collection1/  
[junit4] 2> 329983 T1041 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49746  
[junit4] 2> 329983 T1041 oasc.ZkController.checkRecovery I am the leader, no recovery necessary  
[junit4] 2> 329983 T1041 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection  
[junit4] 2> 329983 T1041 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 329985 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329985 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329985 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 329987 T1041 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 329989 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 329990 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"active",  
[junit4] 2> "base_url":"http://127.0.0.1:49746",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49746_",  
[junit4] 2> "shard":"shard1",  
[junit4] 2> "collection":"control_collection",  
[junit4] 2> "numShards":"3",  
[junit4] 2> "core_node_name":"core_node1"}  
[junit4] 2> 329994 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 330087 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  
[junit4] 2> 330087 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  
[junit4] 2> 331322 T1010 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1  
[junit4] 2> 331323 T1010 oejs.Server.doStart jetty-8.1.10.v20130312  
[junit4] 2> 331328 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49758  
[junit4] 2> 331328 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  
[junit4] 2> 331328 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)  
[junit4] 2> 331329 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003  
[junit4] 2> 331329 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\'  
[junit4] 2> 331354 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\solr.xml  
[junit4] 2> 331376 T1010 oasc.CoreContainer.<init> New CoreContainer 1787614664  
[junit4] 2> 331377 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\]  
[junit4] 2> 331378 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000  
[junit4] 2> 331378 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:  
[junit4] 2> 331379 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000  
[junit4] 2> 331379 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20  
[junit4] 2> 331379 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  
[junit4] 2> 331380 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647  
[junit4] 2> 331380 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5  
[junit4] 2> 331380 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  
[junit4] 2> 331381 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false  
[junit4] 2> 331381 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory  
[junit4] 2> 331381 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]  
[junit4] 2> 331382 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1  
[junit4] 2> 331382 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr  
[junit4] 2> 331382 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot  
[junit4] 2> 331385 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 331408 T1054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b42f06 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 331408 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 331418 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 331423 T1056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d785cb5 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 331423 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 331439 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...  
[junit4] 2> 332356 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49758_  
[junit4] 2> 332362 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49758_  
[junit4] 2> 332389 T1057 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1  
[junit4] 2> 332389 T1057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 332393 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 332393 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 332394 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 332393 T1057 oasc.ZkController.waitForCoreNodeName look for our core node name  
[junit4] 2> 332399 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 332401 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"down",  
[junit4] 2> "base_url":"http://127.0.0.1:49758",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49758_",  
[junit4] 2> "shard":null,  
[junit4] 2> "collection":"collection1",  
[junit4] 2> "numShards":"3",  
[junit4] 2> "core_node_name":null}  
[junit4] 2> 332401 T1035 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]  
[junit4] 2> 332402 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2  
[junit4] 2> 332411 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 332414 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 332415 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 332415 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 333374 T1057 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1  
[junit4] 2> 333374 T1057 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1  
[junit4] 2> 333376 T1057 oasc.ZkController.createCollectionZkNode Collection zkNode exists  
[junit4] 2> 333376 T1057 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1  
[junit4] 2> 333380 T1057 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 333380 T1057 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\collection1\'  
[junit4] 2> 333385 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-003/collection1/lib/.svn/' to classloader  
[junit4] 2> 333385 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-003/collection1/lib/classes/' to classloader  
[junit4] 2> 333388 T1057 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-003/collection1/lib/README' to classloader  
[junit4] 2> 333444 T1057 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0  
[junit4] 2> 333459 T1057 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml  
[junit4] 2> 333463 T1057 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml  
[junit4] 2> 333469 T1057 oass.IndexSchema.readSchema [collection1] Schema name=test  
[junit4] 2> 333584 T1057 oass.IndexSchema.readSchema default search field in schema is text  
[junit4] 2> 333588 T1057 oass.IndexSchema.readSchema unique key field: id  
[junit4] 2> 333588 T1057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml  
[junit4] 2> 333595 T1057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml  
[junit4] 2> 333624 T1057 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1  
[junit4] 2> 333624 T1057 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory  
[junit4] 2> 333625 T1057 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-003\collection1\, dataDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\  
[junit4] 2> 333625 T1057 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3087c433  
[junit4] 2> 333625 T1057 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\  
[junit4] 2> 333625 T1057 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\index/  
[junit4] 2> 333625 T1057 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...  
[junit4] 2> 333627 T1057 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty1\index  
[junit4] 2> 333627 T1057 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6407478258937532]  
[junit4] 2> 333627 T1057 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1  
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@30903c65 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f0760cc),segFN=segments_1,generation=1}  
[junit4] 2> 333627 T1057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1  
[junit4] 2> 333630 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"  
[junit4] 2> 333630 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"  
[junit4] 2> 333630 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"  
[junit4] 2> 333630 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"  
[junit4] 2> 333631 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"  
[junit4] 2> 333631 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"  
[junit4] 2> 333631 T1057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"  
[junit4] 2> 333633 T1057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"  
[junit4] 2> 333633 T1057 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default  
[junit4] 2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler  
[junit4] 2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler  
[junit4] 2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler  
[junit4] 2> 333635 T1057 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler  
[junit4] 2> 333636 T1057 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler  
[junit4] 2> 333636 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers  
[junit4] 2> 333636 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler  
[junit4] 2> 333637 T1057 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler  
[junit4] 2> 333642 T1057 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60  
[junit4] 2> 333644 T1057 oasu.CommitTracker.<init> Hard AutoCommit: disabled  
[junit4] 2> 333644 T1057 oasu.CommitTracker.<init> Soft AutoCommit: disabled  
[junit4] 2> 333646 T1057 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=66.6376953125, floorSegmentMB=0.578125, forceMergeDeletesPctAllowed=18.561335697448744, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7539073758598878  
[junit4] 2> 333646 T1057 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1  
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@30903c65 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f0760cc),segFN=segments_1,generation=1}  
[junit4] 2> 333646 T1057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1  
[junit4] 2> 333647 T1057 oass.SolrIndexSearcher.<init> Opening Searcher@2084a7f7[collection1] main  
[junit4] 2> 333647 T1057 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1  
[junit4] 2> 333648 T1057 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 333648 T1057 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1  
[junit4] 2> 333649 T1057 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1  
[junit4] 2> 333649 T1057 oasr.RestManager.init Initializing RestManager with initArgs: {}  
[junit4] 2> 333649 T1057 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1  
[junit4] 2> 333650 T1057 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json  
[junit4] 2> 333650 T1057 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1  
[junit4] 2> 333650 T1057 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed  
[junit4] 2> 333650 T1057 oasr.RestManager.init Initializing 0 registered ManagedResources  
[junit4] 2> 333654 T1057 oasc.CoreContainer.registerCore registering core: collection1  
[junit4] 2> 333654 T1058 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2084a7f7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}  
[junit4] 2> 333657 T1061 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49758 collection:collection1 shard:shard2  
[junit4] 2> 333658 T1010 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0  
[junit4] 2> 333658 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done  
[junit4] 2> 333669 T1061 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election  
[junit4] 2> 333935 T1061 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2  
[junit4] 2> 333938 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 333939 T1061 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.  
[junit4] 2> 333939 T1061 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync  
[junit4] 2> ASYNC NEW_CORE C401 name=collection1 org.apache.solr.core.SolrCore@2a105534 url=http://127.0.0.1:49758/collection1 node=127.0.0.1:49758_ C401_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:49758, core=collection1, node_name=127.0.0.1:49758_}  
[junit4] 2> 333939 T1061 C401 P49758 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49758/collection1/  
[junit4] 2> 333939 T1061 C401 P49758 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me  
[junit4] 2> 333939 T1061 C401 P49758 oasc.SyncStrategy.syncToMe http://127.0.0.1:49758/collection1/ has no replicas  
[junit4] 2> 333939 T1061 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49758/collection1/ shard2  
[junit4] 2> 333941 T1061 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2  
[junit4] 2> 333942 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 333949 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 333952 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 333952 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 333952 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 333960 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 333964 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 334067 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 334068 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 334068 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 334106 T1061 oasc.ZkController.register We are http://127.0.0.1:49758/collection1/ and leader is http://127.0.0.1:49758/collection1/  
[junit4] 2> 334106 T1061 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49758  
[junit4] 2> 334106 T1061 oasc.ZkController.checkRecovery I am the leader, no recovery necessary  
[junit4] 2> 334106 T1061 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1  
[junit4] 2> 334106 T1061 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 334109 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 334109 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 334109 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 334111 T1061 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 334113 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 334113 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"active",  
[junit4] 2> "base_url":"http://127.0.0.1:49758",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49758_",  
[junit4] 2> "shard":"shard2",  
[junit4] 2> "collection":"collection1",  
[junit4] 2> "numShards":"3",  
[junit4] 2> "core_node_name":"core_node1"}  
[junit4] 2> 334118 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 334222 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 334222 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 334222 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  
[junit4] 2> 335443 T1010 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2  
[junit4] 2> 335444 T1010 oejs.Server.doStart jetty-8.1.10.v20130312  
[junit4] 2> 335462 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49767  
[junit4] 2> 335465 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  
[junit4] 2> 335466 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)  
[junit4] 2> 335467 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004  
[junit4] 2> 335467 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\'  
[junit4] 2> 335496 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\solr.xml  
[junit4] 2> 335512 T1010 oasc.CoreContainer.<init> New CoreContainer 1050527731  
[junit4] 2> 335513 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\]  
[junit4] 2> 335514 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000  
[junit4] 2> 335514 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:  
[junit4] 2> 335515 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000  
[junit4] 2> 335516 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20  
[junit4] 2> 335516 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  
[junit4] 2> 335518 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647  
[junit4] 2> 335518 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5  
[junit4] 2> 335519 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  
[junit4] 2> 335520 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false  
[junit4] 2> 335521 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory  
[junit4] 2> 335521 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]  
[junit4] 2> 335522 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1  
[junit4] 2> 335523 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr  
[junit4] 2> 335523 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot  
[junit4] 2> 335526 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 335547 T1072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a446b0 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 335547 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 335558 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 335561 T1074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b34a302 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 335561 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 335581 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...  
[junit4] 2> 336568 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49767_  
[junit4] 2> 336572 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49767_  
[junit4] 2> 336601 T1075 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1  
[junit4] 2> 336601 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 336605 T1075 oasc.ZkController.waitForCoreNodeName look for our core node name  
[junit4] 2> 336606 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 336606 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 336606 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 336611 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 336613 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"down",  
[junit4] 2> "base_url":"http://127.0.0.1:49767",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49767_",  
[junit4] 2> "shard":null,  
[junit4] 2> "collection":"collection1",  
[junit4] 2> "numShards":"3",  
[junit4] 2> "core_node_name":null}  
[junit4] 2> 336614 T1035 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3  
[junit4] 2> 336614 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3  
[junit4] 2> 336624 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 336628 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 336628 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 336629 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 336628 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 337586 T1075 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1  
[junit4] 2> 337586 T1075 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1  
[junit4] 2> 337588 T1075 oasc.ZkController.createCollectionZkNode Collection zkNode exists  
[junit4] 2> 337588 T1075 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1  
[junit4] 2> 337592 T1075 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 337592 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\collection1\'  
[junit4] 2> 337601 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-004/collection1/lib/.svn/' to classloader  
[junit4] 2> 337601 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-004/collection1/lib/classes/' to classloader  
[junit4] 2> 337601 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-004/collection1/lib/README' to classloader  
[junit4] 2> 337650 T1075 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0  
[junit4] 2> 337664 T1075 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml  
[junit4] 2> 337675 T1075 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml  
[junit4] 2> 337684 T1075 oass.IndexSchema.readSchema [collection1] Schema name=test  
[junit4] 2> 337806 T1075 oass.IndexSchema.readSchema default search field in schema is text  
[junit4] 2> 337809 T1075 oass.IndexSchema.readSchema unique key field: id  
[junit4] 2> 337809 T1075 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml  
[junit4] 2> 337814 T1075 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml  
[junit4] 2> 337856 T1075 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1  
[junit4] 2> 337856 T1075 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory  
[junit4] 2> 337856 T1075 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-004\collection1\, dataDir=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\  
[junit4] 2> 337856 T1075 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3087c433  
[junit4] 2> 337857 T1075 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\  
[junit4] 2> 337857 T1075 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\index/  
[junit4] 2> 337857 T1075 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...  
[junit4] 2> 337857 T1075 oasc.CachingDirectoryFactory.get return new directory for .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-001/jetty2\index  
[junit4] 2> 337858 T1075 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6407478258937532]  
[junit4] 2> 337859 T1075 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1  
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2428f4ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e27d298),segFN=segments_1,generation=1}  
[junit4] 2> 337859 T1075 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1  
[junit4] 2> 337863 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"  
[junit4] 2> 337863 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"  
[junit4] 2> 337864 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"  
[junit4] 2> 337864 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"  
[junit4] 2> 337864 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"  
[junit4] 2> 337864 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"  
[junit4] 2> 337865 T1075 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"  
[junit4] 2> 337865 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"  
[junit4] 2> 337865 T1075 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default  
[junit4] 2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler  
[junit4] 2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler  
[junit4] 2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler  
[junit4] 2> 337866 T1075 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler  
[junit4] 2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler  
[junit4] 2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers  
[junit4] 2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler  
[junit4] 2> 337868 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler  
[junit4] 2> 337872 T1075 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60  
[junit4] 2> 337879 T1075 oasu.CommitTracker.<init> Hard AutoCommit: disabled  
[junit4] 2> 337879 T1075 oasu.CommitTracker.<init> Soft AutoCommit: disabled  
[junit4] 2> 337881 T1075 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=66.6376953125, floorSegmentMB=0.578125, forceMergeDeletesPctAllowed=18.561335697448744, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7539073758598878  
[junit4] 2> 337881 T1075 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1  
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2428f4ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e27d298),segFN=segments_1,generation=1}  
[junit4] 2> 337882 T1075 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1  
[junit4] 2> 337882 T1075 oass.SolrIndexSearcher.<init> Opening Searcher@6e1b9a95[collection1] main  
[junit4] 2> 337882 T1075 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1  
[junit4] 2> 337884 T1075 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 337884 T1075 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1  
[junit4] 2> 337886 T1075 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1  
[junit4] 2> 337886 T1075 oasr.RestManager.init Initializing RestManager with initArgs: {}  
[junit4] 2> 337886 T1075 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1  
[junit4] 2> 337887 T1075 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json  
[junit4] 2> 337887 T1075 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1  
[junit4] 2> 337887 T1075 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed  
[junit4] 2> 337888 T1075 oasr.RestManager.init Initializing 0 registered ManagedResources  
[junit4] 2> 337890 T1076 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e1b9a95[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}  
[junit4] 2> 337891 T1075 oasc.CoreContainer.registerCore registering core: collection1  
[junit4] 2> 337892 T1079 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49767 collection:collection1 shard:shard3  
[junit4] 2> 337893 T1010 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0  
[junit4] 2> 337893 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done  
[junit4] 2> 337896 T1079 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election  
[junit4] 2> 337909 T1079 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3  
[junit4] 2> 337913 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 337914 T1079 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.  
[junit4] 2> 337914 T1079 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync  
[junit4] 2> ASYNC NEW_CORE C402 name=collection1 org.apache.solr.core.SolrCore@12e876c1 url=http://127.0.0.1:49767/collection1 node=127.0.0.1:49767_ C402_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:49767, core=collection1, node_name=127.0.0.1:49767_}  
[junit4] 2> 337915 T1079 C402 P49767 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49767/collection1/  
[junit4] 2> 337915 T1079 C402 P49767 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me  
[junit4] 2> 337915 T1079 C402 P49767 oasc.SyncStrategy.syncToMe http://127.0.0.1:49767/collection1/ has no replicas  
[junit4] 2> 337915 T1079 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49767/collection1/ shard3  
[junit4] 2> 337916 T1079 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3  
[junit4] 2> 337917 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 337927 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 337932 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 337938 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 338040 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338040 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338041 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338042 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338084 T1079 oasc.ZkController.register We are http://127.0.0.1:49767/collection1/ and leader is http://127.0.0.1:49767/collection1/  
[junit4] 2> 338084 T1079 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49767  
[junit4] 2> 338084 T1079 oasc.ZkController.checkRecovery I am the leader, no recovery necessary  
[junit4] 2> 338084 T1079 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1  
[junit4] 2> 338084 T1079 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 338087 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 338087 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 338087 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 338089 T1079 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 338091 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 338091 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"active",  
[junit4] 2> "base_url":"http://127.0.0.1:49767",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49767_",  
[junit4] 2> "shard":"shard3",  
[junit4] 2> "collection":"collection1",  
[junit4] 2> "numShards":"3",  
[junit4] 2> "core_node_name":"core_node2"}  
[junit4] 2> 338100 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 338203 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338203 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338203 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 338203 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  
[junit4] 2> 339683 T1010 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3  
[junit4] 2> 339683 T1010 oejs.Server.doStart jetty-8.1.10.v20130312  
[junit4] 2> 339687 T1010 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49776  
[junit4] 2> 339688 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  
[junit4] 2> 339690 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)  
[junit4] 2> 339690 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005  
[junit4] 2> 339690 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\'  
[junit4] 2> 339725 T1010 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\solr.xml  
[junit4] 2> 339744 T1010 oasc.CoreContainer.<init> New CoreContainer 1139840461  
[junit4] 2> 339744 T1010 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\]  
[junit4] 2> 339745 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  
[junit4] 2> 339746 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false  
[junit4] 2> 339746 T1010 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory  
[junit4] 2> 339746 T1010 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]  
[junit4] 2> 339750 T1010 oasc.CoreContainer.load Host Name: 127.0.0.1  
[junit4] 2> 339750 T1010 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49739/solr  
[junit4] 2> 339750 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot  
[junit4] 2> 339753 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 339788 T1092 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37a87021 name:ZooKeeperConnection Watcher:127.0.0.1:49739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 339789 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 339801 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper  
[junit4] 2> 339806 T1094 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72257366 name:ZooKeeperConnection Watcher:127.0.0.1:49739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None  
[junit4] 2> 339806 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  
[junit4] 2> 339825 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...  
[junit4] 2> 340810 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49776_  
[junit4] 2> 340815 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49776_  
[junit4] 2> 340851 T1095 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1  
[junit4] 2> 340852 T1095 oasc.ZkController.publish numShards not found on descriptor - reading it from system property  
[junit4] 2> 340858 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 340858 T1095 oasc.ZkController.waitForCoreNodeName look for our core node name  
[junit4] 2> 340858 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 340860 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 340866 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...  
[junit4] 2> 340868 T1035 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  
[junit4] 2> "operation":"state",  
[junit4] 2> "state":"down",  
[junit4] 2> "base_url":"http://127.0.0.1:49776",  
[junit4] 2> "core":"collection1",  
[junit4] 2> "roles":null,  
[junit4] 2> "node_name":"127.0.0.1:49776_",  
[junit4] 2> "shard":null,  
[junit4] 2> "collection":"collection1",  
[junit4] 2> "numShards":"3",  
[junit4] 2> "core_node_name":null}  
[junit4] 2> 340868 T1035 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3  
[junit4] 2> 340869 T1035 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1  
[junit4] 2> 340880 T1034 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 340884 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)  
[junit4] 2> 340885 T1034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)  
[junit4] 2> 340886 T1094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)  
[junit4] 2> 340886 T1056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)  
[junit4] 2> 340886 T1043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)  
[junit4] 2> 341839 T1095 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1  
[junit4] 2> 341839 T1095 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1  
[junit4] 2> 341840 T1095 oasc.ZkController.createCollectionZkNode Collection zkNode exists  
[junit4] 2> 341841 T1095 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1  
[junit4] 2> 341844 T1095 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper  
[junit4] 2> 341845 T1095 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-005\collection1\'  
[junit4] 2> 341852 T1095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-005/collection1/lib/.svn/' to classloader  
[junit4] 2> 341855 T1095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-005/collection1/lib/classes/' to classloader  
[junit4] 2> 341857 T1095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001/tempDir-005/collection1/lib/REA  

[...truncated too long message...]  

chChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 437803 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 437804 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 437804 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> 437804 T1112 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.method=testDistribSearch -Dtests.seed=7EB301D397A52785 -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=Iceland -Dtests.file.encoding=Cp1252  
[junit4] FAILURE 111s | FullSolrCloudDistribCmdsTest.testDistribSearch <<<  
[junit4] > Throwable #1: java.lang.AssertionError: Control does not match cloud expected:<392> but was:<329>  
[junit4] > at __randomizedtesting.SeedInfo.seed([7EB301D397A52785:FF558FCBE0FA47B9]:0)  
[junit4] > at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:417)  
[junit4] > at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)  
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)  
[junit4] > at java.lang.Thread.run(Thread.java:745)  
[junit4] 2> 437813 T1010 oas.SolrTestCaseJ4.deleteCore ###deleteCore  
[junit4] 2> 437820 T1360 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=64,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=9764,transaction_logs_total_number=1}  
[junit4] 2> 437820 T1360 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState  
[junit4] 2> 437820 T1360 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter  
[junit4] 2> 437820 T1360 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser  
[junit4] 2> 437823 T1360 oasc.SolrCore.closeSearcher [collection2_shard2_replica2] Closing main searcher on request.  
[junit4] 2> 437823 T1360 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked  
[junit4] 2> 437823 T1360 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\ [CachedDir<<refCount=0;path=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\;done=false>>]  
[junit4] 2> 437823 T1360 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\  
[junit4] 2> 437823 T1360 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\index [CachedDir<<refCount=0;path=.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\index;done=false>>]  
[junit4] 2> 437823 T1360 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001\tempDir-007\collection2_shard2_replica2\data\index  
[junit4] 2> 437823 T1360 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard4/election  
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)  
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)  
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)  
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)  
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)  
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)  
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)  
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)  
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)  
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)  
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)  
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)  
[junit4] 2>  
[junit4] 2> 437823 T1360 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election  
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)  
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)  
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)  
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)  
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)  
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)  
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)  
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)  
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)  
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)  
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)  
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)  
[junit4] 2>  
[junit4] 2> 437823 T1360 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK  
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solr.cloud.FullSolrCloudDistribCmdsTest-7EB301D397A52785-001  
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=lv_LV, timezone=Iceland  
[junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=2,threads=1,free=58199376,total=142868480  
[junit4] 2> NOTE: All tests run in this JVM: [TestCloudInspectUtil, PrimUtilsTest, TestMultiCoreConfBootstrap, HdfsWriteToMultipleCollectionsTest, ZkSolrClientTest, HighlighterConfigTest, TestSolrJ, DocumentBuilderTest, StatelessScriptUpdateProcessorFactoryTest, FileBasedSpellCheckerTest, TestClassNameShortening, WordBreakSolrSpellCheckerTest, ConvertedLegacyTest, ChaosMonkeyNothingIsSafeTest, SolrCoreCheckLockOnStartupTest, UnloadDistributedZkTest, TestRangeQuery, ModifyConfFileTest, BadCopyFieldTest, ResponseLogComponentTest, RAMDirectoryFactoryTest, DistributedExpandComponentTest, SolrRequestParserTest, TestJoin, DirectSolrSpellCheckerTest, TestImplicitCoreProperties, QueryEqualityTest, QueryResultKeyTest, TestDFRSimilarityFactory, SolrIndexSplitterTest, TestStressRecovery, BasicZkTest, TestSearchPerf, CircularListTest, TestSolrXmlPersistence, LoggingHandlerTest, QueryParsingTest, DistributedQueryElevationComponentTest, TestRecovery, TestArbitraryIndexDir, TestStressUserVersions, TestSearcherReuse, TestManagedResourceStorage, TestCharFilters, FullSolrCloudDistribCmdsTest]  
[junit4] Completed in 111.98s, 1 test, 1 failure <<< FAILURES!  

[...truncated 1087 lines...]  
BUILD FAILED  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1296: The following error occurred while executing this line:  
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:920: There were test failures: 398 suites, 1673 tests, 1 failure, 42 ignored (21 assumptions)  

Total time: 87 minutes 10 seconds  
Build step 'Invoke Ant' marked build as failure  
Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC  
Archiving artifacts  
Recording test results  
Email was triggered for: Failure  
Sending email for trigger: Failure  



---------------------------------------------------------------------  
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org  
For additional commands, e-mail: dev-help@lucene.apache.org