You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/08 20:33:38 UTC

[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk7) - Build # 8134 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/8134/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Can not find: /onenodecollectioncore/update</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /onenodecollectioncore/update. Reason: <pre>    Can not find: /onenodecollectioncore/update</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Can not find: /onenodecollectioncore/update</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /onenodecollectioncore/update. Reason:
<pre>    Can not find: /onenodecollectioncore/update</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([F653D8B7B7C5FC77:77B556AFC09A9C4B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)




Build Log:
[...truncated 10419 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 474235 T1362 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 474239 T1362 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1383938222662
   [junit4]   2> 474240 T1362 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 474240 T1363 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 474341 T1362 oasc.ZkTestServer.run start zk server on port:35078
   [junit4]   2> 474343 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 474427 T1369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef13bff5 name:ZooKeeperConnection Watcher:127.0.0.1:35078 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 474428 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 474429 T1362 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 474439 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 474442 T1371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d90e805a name:ZooKeeperConnection Watcher:127.0.0.1:35078/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 474443 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 474444 T1362 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 474450 T1362 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 474455 T1362 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 474461 T1362 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 474467 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 474469 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 474477 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 474479 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 474485 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 474486 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 474492 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 474494 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 474500 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 474502 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 474507 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 474508 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 474513 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 474515 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 474521 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 474523 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 474529 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 474531 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 474536 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 474537 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 474539 T1362 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 474540 T1362 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 474616 T1362 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 474627 T1362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49997
   [junit4]   2> 474628 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 474629 T1362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 474630 T1362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964
   [junit4]   2> 474631 T1362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/'
   [junit4]   2> 474641 T1362 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/solr.xml
   [junit4]   2> 474682 T1362 oasc.CoreContainer.<init> New CoreContainer 545669138
   [junit4]   2> 474684 T1362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/]
   [junit4]   2> 474686 T1362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 474687 T1362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 474687 T1362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 474688 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 474689 T1362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 474690 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 474691 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 474692 T1362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 474693 T1362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 474695 T1362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 474696 T1362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 474697 T1362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35078/solr
   [junit4]   2> 474698 T1362 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 474701 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 474703 T1384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8db1f1e name:ZooKeeperConnection Watcher:127.0.0.1:35078 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 474704 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 474709 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 474710 T1386 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e24d6580 name:ZooKeeperConnection Watcher:127.0.0.1:35078/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 474710 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 474712 T1362 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 474715 T1362 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 474718 T1362 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 474720 T1362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49997_
   [junit4]   2> 474722 T1362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49997_
   [junit4]   2> 474726 T1362 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 474733 T1362 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 474736 T1362 oasc.Overseer.start Overseer (id=90697775360638979-127.0.0.1:49997_-n_0000000000) starting
   [junit4]   2> 474739 T1362 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 474743 T1388 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 474744 T1362 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 474747 T1362 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 474749 T1362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 474751 T1387 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 474754 T1389 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 474754 T1389 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 474755 T1389 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 476256 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 476258 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49997",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49997_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 476259 T1387 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 476260 T1387 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 476267 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 476756 T1389 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 476756 T1389 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/collection1
   [junit4]   2> 476756 T1389 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 476757 T1389 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 476757 T1389 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 476759 T1389 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/collection1/'
   [junit4]   2> 476759 T1389 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/collection1/lib/classes/' to classloader
   [junit4]   2> 476760 T1389 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/collection1/lib/README' to classloader
   [junit4]   2> 476793 T1389 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 476846 T1389 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 476848 T1389 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 476855 T1389 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 477171 T1389 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 477172 T1389 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 477172 T1389 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 477177 T1389 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 477179 T1389 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 477193 T1389 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 477197 T1389 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 477203 T1389 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 477205 T1389 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 477205 T1389 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 477206 T1389 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 477207 T1389 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 477208 T1389 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 477209 T1389 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 477210 T1389 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1383938222964/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/control/data/
   [junit4]   2> 477211 T1389 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f45b0c5f
   [junit4]   2> 477214 T1389 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/control/data
   [junit4]   2> 477215 T1389 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/control/data/index/
   [junit4]   2> 477216 T1389 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 477217 T1389 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/control/data/index
   [junit4]   2> 477217 T1389 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=32.4228515625, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=2.897934710231839, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 477218 T1389 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@e4230551 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@fbe1aa41),segFN=segments_1,generation=1}
   [junit4]   2> 477219 T1389 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 477221 T1389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 477222 T1389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 477222 T1389 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 477222 T1389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 477223 T1389 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 477223 T1389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 477224 T1389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 477224 T1389 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 477224 T1389 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 477225 T1389 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 477225 T1389 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 477226 T1389 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 477226 T1389 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 477226 T1389 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 477227 T1389 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 477228 T1389 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 477231 T1389 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 477231 T1389 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 477231 T1389 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5788627648287221]
   [junit4]   2> 477232 T1389 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@e4230551 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@fbe1aa41),segFN=segments_1,generation=1}
   [junit4]   2> 477232 T1389 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 477233 T1389 oass.SolrIndexSearcher.<init> Opening Searcher@cb82d57a main
   [junit4]   2> 477235 T1390 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cb82d57a main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 477236 T1389 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 477236 T1389 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49997 collection:control_collection shard:shard1
   [junit4]   2> 477237 T1389 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 477243 T1389 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 477245 T1389 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 477246 T1389 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 477246 T1389 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49997/collection1/
   [junit4]   2> 477246 T1389 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 477247 T1389 oasc.SyncStrategy.syncToMe http://127.0.0.1:49997/collection1/ has no replicas
   [junit4]   2> 477247 T1389 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49997/collection1/ shard1
   [junit4]   2> 477247 T1389 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 477774 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 477789 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 477805 T1389 oasc.ZkController.register We are http://127.0.0.1:49997/collection1/ and leader is http://127.0.0.1:49997/collection1/
   [junit4]   2> 477805 T1389 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49997
   [junit4]   2> 477806 T1389 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 477806 T1389 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 477806 T1389 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 477808 T1389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 477809 T1362 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 477810 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 477814 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 477817 T1393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f42abeb9 name:ZooKeeperConnection Watcher:127.0.0.1:35078/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 477817 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 477820 T1362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 477824 T1362 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 477895 T1362 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 477901 T1362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40183
   [junit4]   2> 477902 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 477903 T1362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 477903 T1362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247
   [junit4]   2> 477904 T1362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/'
   [junit4]   2> 477911 T1362 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/solr.xml
   [junit4]   2> 477941 T1362 oasc.CoreContainer.<init> New CoreContainer -1960873384
   [junit4]   2> 477942 T1362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/]
   [junit4]   2> 477943 T1362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 477944 T1362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 477944 T1362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 477945 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 477945 T1362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 477946 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 477946 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 477947 T1362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 477947 T1362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 477949 T1362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 477949 T1362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 477950 T1362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35078/solr
   [junit4]   2> 477950 T1362 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 477954 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 477955 T1404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45b9b198 name:ZooKeeperConnection Watcher:127.0.0.1:35078 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 477956 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 477960 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 477962 T1406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7db8fa2a name:ZooKeeperConnection Watcher:127.0.0.1:35078/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 477962 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 477966 T1362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 478970 T1362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40183_
   [junit4]   2> 478971 T1362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40183_
   [junit4]   2> 478974 T1386 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 478974 T1393 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 478974 T1406 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 478980 T1407 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 478980 T1407 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 478981 T1407 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 479300 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 479301 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49997",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49997_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 479308 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:40183",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:40183_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 479309 T1387 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 479310 T1387 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 479319 T1393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 479319 T1406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 479320 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 479981 T1407 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 479982 T1407 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/collection1
   [junit4]   2> 479982 T1407 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 479983 T1407 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 479983 T1407 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 479984 T1407 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/collection1/'
   [junit4]   2> 479985 T1407 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/collection1/lib/classes/' to classloader
   [junit4]   2> 479986 T1407 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/collection1/lib/README' to classloader
   [junit4]   2> 480018 T1407 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 480053 T1407 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 480055 T1407 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 480063 T1407 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 480408 T1407 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 480408 T1407 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 480409 T1407 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 480415 T1407 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 480417 T1407 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 480429 T1407 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 480434 T1407 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 480439 T1407 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 480442 T1407 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 480442 T1407 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 480442 T1407 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 480444 T1407 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 480444 T1407 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 480444 T1407 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 480445 T1407 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1383938226247/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty1/
   [junit4]   2> 480445 T1407 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f45b0c5f
   [junit4]   2> 480446 T1407 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty1
   [junit4]   2> 480446 T1407 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty1/index/
   [junit4]   2> 480447 T1407 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 480447 T1407 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty1/index
   [junit4]   2> 480449 T1407 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=32.4228515625, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=2.897934710231839, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 480450 T1407 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@ac37bdd8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@92806ab6),segFN=segments_1,generation=1}
   [junit4]   2> 480451 T1407 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 480454 T1407 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 480454 T1407 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 480454 T1407 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 480455 T1407 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 480455 T1407 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 480455 T1407 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 480456 T1407 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 480457 T1407 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 480457 T1407 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 480458 T1407 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 480459 T1407 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 480459 T1407 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 480460 T1407 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 480460 T1407 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 480461 T1407 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 480463 T1407 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 480466 T1407 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 480466 T1407 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 480467 T1407 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5788627648287221]
   [junit4]   2> 480467 T1407 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@ac37bdd8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@92806ab6),segFN=segments_1,generation=1}
   [junit4]   2> 480470 T1407 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 480470 T1407 oass.SolrIndexSearcher.<init> Opening Searcher@716b1cd3 main
   [junit4]   2> 480473 T1408 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@716b1cd3 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 480475 T1407 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 480475 T1407 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40183 collection:collection1 shard:shard1
   [junit4]   2> 480476 T1407 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 480482 T1407 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 480485 T1407 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 480485 T1407 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 480485 T1407 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40183/collection1/
   [junit4]   2> 480486 T1407 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 480486 T1407 oasc.SyncStrategy.syncToMe http://127.0.0.1:40183/collection1/ has no replicas
   [junit4]   2> 480486 T1407 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40183/collection1/ shard1
   [junit4]   2> 480487 T1407 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 480829 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 480837 T1393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 480837 T1406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 480837 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 480843 T1407 oasc.ZkController.register We are http://127.0.0.1:40183/collection1/ and leader is http://127.0.0.1:40183/collection1/
   [junit4]   2> 480843 T1407 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40183
   [junit4]   2> 480844 T1407 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 480844 T1407 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 480845 T1407 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 480848 T1407 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 480850 T1362 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 480851 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 480920 T1362 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 480924 T1362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58914
   [junit4]   2> 480925 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 480926 T1362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 480926 T1362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275
   [junit4]   2> 480927 T1362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/'
   [junit4]   2> 480935 T1362 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/solr.xml
   [junit4]   2> 480965 T1362 oasc.CoreContainer.<init> New CoreContainer 1650208782
   [junit4]   2> 480966 T1362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/]
   [junit4]   2> 480967 T1362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 480968 T1362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 480968 T1362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 480969 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 480969 T1362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 480970 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 480970 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 480971 T1362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 480972 T1362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 480973 T1362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 480973 T1362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 480974 T1362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35078/solr
   [junit4]   2> 480974 T1362 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 480977 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 480978 T1420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4961b2b4 name:ZooKeeperConnection Watcher:127.0.0.1:35078 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 480979 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 480983 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 480984 T1422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14644ff3 name:ZooKeeperConnection Watcher:127.0.0.1:35078/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 480985 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 480988 T1362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 481991 T1362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58914_
   [junit4]   2> 481992 T1362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58914_
   [junit4]   2> 481996 T1393 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 481996 T1386 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 481997 T1406 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 481996 T1422 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 482007 T1423 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 482007 T1423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 482009 T1423 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 482342 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 482343 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:40183",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:40183_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 482347 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58914",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58914_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 482347 T1387 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 482347 T1387 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 482352 T1393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 482352 T1406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 482352 T1422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 482354 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483010 T1423 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 483010 T1423 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/collection1
   [junit4]   2> 483011 T1423 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 483012 T1423 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 483012 T1423 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 483013 T1423 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/collection1/'
   [junit4]   2> 483014 T1423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/collection1/lib/classes/' to classloader
   [junit4]   2> 483015 T1423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/collection1/lib/README' to classloader
   [junit4]   2> 483049 T1423 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 483082 T1423 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 483084 T1423 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 483094 T1423 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 483692 T1423 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 483693 T1423 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 483695 T1423 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 483705 T1423 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 483709 T1423 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 483748 T1423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 483754 T1423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 483760 T1423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 483761 T1423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 483762 T1423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 483762 T1423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 483764 T1423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 483764 T1423 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 483765 T1423 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 483765 T1423 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1383938229275/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty2/
   [junit4]   2> 483766 T1423 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f45b0c5f
   [junit4]   2> 483767 T1423 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty2
   [junit4]   2> 483768 T1423 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty2/index/
   [junit4]   2> 483768 T1423 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 483769 T1423 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty2/index
   [junit4]   2> 483770 T1423 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=32.4228515625, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=2.897934710231839, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 483771 T1423 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1e8d6ebb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9113f309),segFN=segments_1,generation=1}
   [junit4]   2> 483772 T1423 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 483776 T1423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 483776 T1423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 483777 T1423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 483778 T1423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 483778 T1423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 483779 T1423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 483779 T1423 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 483780 T1423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 483781 T1423 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 483781 T1423 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 483782 T1423 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 483783 T1423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 483783 T1423 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 483784 T1423 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 483785 T1423 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 483787 T1423 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 483790 T1423 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 483790 T1423 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 483791 T1423 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5788627648287221]
   [junit4]   2> 483792 T1423 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1e8d6ebb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9113f309),segFN=segments_1,generation=1}
   [junit4]   2> 483792 T1423 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 483792 T1423 oass.SolrIndexSearcher.<init> Opening Searcher@abc97756 main
   [junit4]   2> 483796 T1424 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@abc97756 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 483797 T1423 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 483798 T1423 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58914 collection:collection1 shard:shard2
   [junit4]   2> 483799 T1423 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 483808 T1423 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 483811 T1423 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 483812 T1423 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 483812 T1423 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58914/collection1/
   [junit4]   2> 483813 T1423 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 483813 T1423 oasc.SyncStrategy.syncToMe http://127.0.0.1:58914/collection1/ has no replicas
   [junit4]   2> 483814 T1423 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58914/collection1/ shard2
   [junit4]   2> 483814 T1423 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 483862 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 483869 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483869 T1393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483869 T1422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483869 T1406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483874 T1423 oasc.ZkController.register We are http://127.0.0.1:58914/collection1/ and leader is http://127.0.0.1:58914/collection1/
   [junit4]   2> 483875 T1423 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58914
   [junit4]   2> 483875 T1423 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 483875 T1423 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 483876 T1423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 483877 T1423 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 483878 T1362 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 483879 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 483978 T1362 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 483984 T1362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52720
   [junit4]   2> 483985 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 483986 T1362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 483987 T1362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303
   [junit4]   2> 483987 T1362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/'
   [junit4]   2> 483998 T1362 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/solr.xml
   [junit4]   2> 484030 T1362 oasc.CoreContainer.<init> New CoreContainer 2085730844
   [junit4]   2> 484030 T1362 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/]
   [junit4]   2> 484032 T1362 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 484032 T1362 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 484033 T1362 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 484034 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 484034 T1362 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 484035 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 484035 T1362 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 484036 T1362 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 484037 T1362 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 484038 T1362 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 484039 T1362 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 484039 T1362 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35078/solr
   [junit4]   2> 484040 T1362 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 484043 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 484047 T1436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36eb4d60 name:ZooKeeperConnection Watcher:127.0.0.1:35078 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 484048 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 484054 T1362 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 484055 T1438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b74a85f9 name:ZooKeeperConnection Watcher:127.0.0.1:35078/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 484055 T1362 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 484061 T1362 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 485067 T1362 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52720_
   [junit4]   2> 485069 T1362 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52720_
   [junit4]   2> 485073 T1393 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 485073 T1406 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 485073 T1438 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 485074 T1422 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 485074 T1386 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 485095 T1439 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 485096 T1439 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 485099 T1439 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 485375 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 485376 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58914",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58914_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 485379 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52720",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:52720_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 485379 T1387 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 485379 T1387 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 485383 T1406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 485384 T1422 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 485384 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 485384 T1386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 485384 T1393 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 486100 T1439 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 486100 T1439 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/collection1
   [junit4]   2> 486101 T1439 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 486102 T1439 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 486102 T1439 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 486103 T1439 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/collection1/'
   [junit4]   2> 486104 T1439 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/collection1/lib/classes/' to classloader
   [junit4]   2> 486105 T1439 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/collection1/lib/README' to classloader
   [junit4]   2> 486161 T1439 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 486212 T1439 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 486213 T1439 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 486225 T1439 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 486626 T1439 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 486627 T1439 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 486627 T1439 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 486633 T1439 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 486635 T1439 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 486648 T1439 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 486652 T1439 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 486657 T1439 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 486658 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 486659 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 486659 T1439 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 486660 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 486660 T1439 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 486661 T1439 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 486661 T1439 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1383938232303/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty3/
   [junit4]   2> 486661 T1439 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f45b0c5f
   [junit4]   2> 486662 T1439 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty3
   [junit4]   2> 486663 T1439 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty3/index/
   [junit4]   2> 486663 T1439 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty3/index' doesn't exist. Creating new index...
   [junit4]   2> 486664 T1439 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1383938222661/jetty3/index
   [junit4]   2> 486664 T1439 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=32.4228515625, floorSegmentMB=0.431640625, forceMergeDeletesPctAllowed=2.897934710231839, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 486665 T1439 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@a5cb279 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@fcdefd4b),segFN=segments_1,generation=1}
   [junit4]   2> 486665 T1439 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 486668 T1439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 486668 T1439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 486669 T1439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 486670 T1439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 486670 T1439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 486671 T1439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 486671 T1439 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 486672 T1439 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 486672 T1439 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 486673 T1439 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 486674 T1439 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 486675 T1439 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 486675 T1439 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 486676 T1439 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 486677 T1439 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 486679 T1439 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 486682 T1439 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 486683 T1439 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 486684 T1439 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5788627648287221]
   [junit4]   2> 486684 T1439 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@a5cb279 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@fcdefd4b),segFN=segments_1,generation=1}
   [junit4]   2> 486685 T1439 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 486685 T1439 oass.SolrIndexSearcher.<init> Opening Searcher@602c29c7 main
   [junit4]   2> 486689 T1440 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@602c29c7 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 486690 T1439 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 486690 T1439 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52720 collection:collection1 shard:shard1
   [junit4]   2> 486694 T1439 oasc.ZkController.register We are http://127.0.0.1:52720/collection1/ and leader is http://127.0.0.1:40183/collection1/
   [junit4]   2> 486694 T1439 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52720
   [junit4]   2> 486695 T1439 oasc.ZkController.checkRecovery Core needs to recover:collection1
   [junit4]   2> 486695 T1439 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
   [junit4]   2> ASYNC  NEW_CORE C803 name=collection1 org.apache.solr.core.SolrCore@bc2a728d url=http://127.0.0.1:52720/collection1 node=127.0.0.1:52720_ C803_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52720, core=collection1, node_name=127.0.0.1:52720_}
   [junit4]   2> 486696 T1441 C803 P52720 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
   [junit4]   2> 486696 T1439 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 486696 T1441 C803 P52720 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
   [junit4]   2> 486697 T1441 C803 P52720 oasc.ZkController.publish publishing core=collection1 state=recovering
   [junit4]   2> 486697 T1441 C803 P52720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 486697 T1362 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 486698 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 486712 T1399 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
   [junit4]   2> 486807 T1362 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 486835 T1362 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53701
   [junit4]   2> 486837 T1362 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 486838 T1362 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 486839 T1362 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1383938235122
   [junit4]   2> 486840 T1362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1383938235122/'
   [junit4]   2> 486854 T1362 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1383938235122/solr.xml
   [junit4]   2> 486892 T1387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 486893 T1387 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52720",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_n

[...truncated too long message...]

-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{"core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:40183",
   [junit4]   1>                   "core":"onenodecollectioncore",
   [junit4]   1>                   "roles":"none",
   [junit4]   1>                   "node_name":"127.0.0.1:40183_",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "replicationFactor":"1"},
   [junit4]   1>         "collection1":{
   [junit4]   1>           "shards":{
   [junit4]   1>             "shard1":{
   [junit4]   1>               "range":"80000000-ffffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:40183",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:40183_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node3":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:52720",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:52720_"}}},
   [junit4]   1>             "shard2":{
   [junit4]   1>               "range":"0-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node2":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:58914",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:58914_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node4":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:53701",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:53701_"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "replicationFactor":"1"}}
   [junit4]   1>  /zookeeper (1)
   [junit4]   1>  DATA:
   [junit4]   1>      
   [junit4]   1> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=F653D8B7B7C5FC77 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs -Dtests.timezone=US/Mountain -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   28.1s J1 | BasicDistributedZk2Test.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 404 Can not find: /onenodecollectioncore/update</title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 404</h2>
   [junit4]    > <p>Problem accessing /onenodecollectioncore/update. Reason:
   [junit4]    > <pre>    Can not find: /onenodecollectioncore/update</pre></p>
   [junit4]    > <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F653D8B7B7C5FC77:77B556AFC09A9C4B]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
   [junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:780)
   [junit4]   2> 502383 T1362 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 28155 T1361 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> 503446 T1455 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=cs, timezone=US/Mountain
   [junit4]   2> NOTE: Linux 3.8.0-32-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=3,free=62242640,total=164691968
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtils, SortByFunctionTest, DefaultValueUpdateProcessorTest, SolrCoreCheckLockOnStartupTest, SolrRequestParserTest, BadIndexSchemaTest, SpellingQueryConverterTest, DateFieldTest, PingRequestHandlerTest, MinimalSchemaTest, TestCSVResponseWriter, TestArbitraryIndexDir, TestSolrDeletionPolicy2, SolrCmdDistributorTest, FullSolrCloudDistribCmdsTest, StandardRequestHandlerTest, TestRecovery, TestFieldTypeResource, HdfsCollectionsAPIDistributedZkTest, TestNRTOpen, TestBinaryResponseWriter, TestSolrJ, HdfsChaosMonkeySafeLeaderTest, DeleteReplicaTest, DirectUpdateHandlerTest, PathHierarchyTokenizerFactoryTest, ZkNodePropsTest, IndexSchemaRuntimeFieldTest, DistanceFunctionTest, XmlUpdateRequestHandlerTest, TestIBSimilarityFactory, TestCollationField, OutputWriterTest, OpenCloseCoreStressTest, TestFastOutputStream, TestCSVLoader, DirectSolrSpellCheckerTest, TestFiltering, SolrIndexConfigTest, TestClassNameShortening, DocValuesMissingTest, TestComponentsName, TestSchemaVersionResource, TestOmitPositions, DisMaxRequestHandlerTest, TestLazyCores, SuggesterWFSTTest, TestDistribDocBasedVersion, TestShardHandlerFactory, TestSweetSpotSimilarityFactory, DirectSolrConnectionTest, TestMultiCoreConfBootstrap, TestSolr4Spatial, TestQuerySenderNoQuery, TestDistributedGrouping, BasicZkTest, XsltUpdateRequestHandlerTest, TestPhraseSuggestions, HighlighterTest, TestSolrQueryParserDefaultOperatorResource, TestMaxScoreQueryParser, RAMDirectoryFactoryTest, ShardRoutingCustomTest, TestReload, TestDynamicFieldResource, CurrencyFieldXmlFileTest, TestNumberUtils, TestSolrCoreProperties, MultiTermTest, TestFieldCollectionResource, TestFieldTypeCollectionResource, EnumFieldTest, TestJmxIntegration, TestAtomicUpdateErrorCases, TestQuerySenderListener, BasicDistributedZk2Test]
   [junit4] Completed on J1 in 29.43s, 1 test, 1 error <<< FAILURES!

[...truncated 655 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:428: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:421: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:483: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:911: There were test failures: 335 suites, 1475 tests, 1 error, 35 ignored (6 assumptions)

Total time: 51 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure