You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/10/16 07:13:26 UTC

[JENKINS] Lucene-Solr-4.x-Linux (32bit/ibm-j9-jdk6) - Build # 7810 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/7810/
Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Can not find: /onenodecollectioncore/update</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /onenodecollectioncore/update. Reason: <pre>    Can not find: /onenodecollectioncore/update</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Can not find: /onenodecollectioncore/update</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /onenodecollectioncore/update. Reason:
<pre>    Can not find: /onenodecollectioncore/update</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([96CB96B7D447A9C2:172D18AFA318C9FE]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
	at java.lang.reflect.Method.invoke(Method.java:611)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:738)




Build Log:
[...truncated 9254 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 11623 T41 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 11631 T41 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1381898792315
   [junit4]   2> 11634 T41 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 11637 T42 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 11737 T41 oasc.ZkTestServer.run start zk server on port:59819
   [junit4]   2> 11799 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 11871 T50 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ca25ca2 name:ZooKeeperConnection Watcher:127.0.0.1:59819 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 11872 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 11874 T41 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 11903 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 11907 T52 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6550655 name:ZooKeeperConnection Watcher:127.0.0.1:59819/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 11908 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 11910 T41 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 11928 T41 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 11947 T41 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 11959 T41 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 11972 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 11977 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 11996 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 12004 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 12017 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 12019 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 12033 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 12035 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 12053 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 12055 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 12068 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 12070 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 12083 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 12084 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 12097 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 12098 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 12147 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 12149 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 12162 T41 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 12163 T41 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 12482 T41 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 12534 T41 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37740
   [junit4]   2> 12607 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 12608 T41 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 12609 T41 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859
   [junit4]   2> 12610 T41 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/'
   [junit4]   2> 12624 T41 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/solr.xml
   [junit4]   2> 12673 T41 oasc.CoreContainer.<init> New CoreContainer 763833735
   [junit4]   2> 12674 T41 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/]
   [junit4]   2> 12679 T41 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 12680 T41 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 12681 T41 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 12682 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 12683 T41 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 12684 T41 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 12684 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 12685 T41 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 12686 T41 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 12687 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 12689 T41 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 12690 T41 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 12692 T41 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59819/solr
   [junit4]   2> 12696 T41 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 12698 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 12703 T64 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52bc52bc name:ZooKeeperConnection Watcher:127.0.0.1:59819 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 12707 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 12714 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 12718 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 12721 T66 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c5d0c5d name:ZooKeeperConnection Watcher:127.0.0.1:59819/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 12722 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 12729 T41 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 12746 T41 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 12769 T41 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 12777 T41 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37740_
   [junit4]   2> 12781 T41 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37740_
   [junit4]   2> 12795 T41 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 12817 T41 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 12839 T41 oasc.Overseer.start Overseer (id=90564119258202115-127.0.0.1:37740_-n_0000000000) starting
   [junit4]   2> 12860 T41 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 12879 T68 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 12881 T41 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 12896 T41 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 12910 T41 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 12927 T67 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 12933 T69 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 12934 T69 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 12938 T69 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 14443 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 14447 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:37740",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:37740_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 14448 T67 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 14451 T67 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 14502 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 14939 T69 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 14940 T69 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/collection1
   [junit4]   2> 14941 T69 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 14944 T69 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 14945 T69 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 14950 T69 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/collection1/'
   [junit4]   2> 14952 T69 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/collection1/lib/classes/' to classloader
   [junit4]   2> 14954 T69 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/collection1/lib/README' to classloader
   [junit4]   2> 15027 T69 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 15076 T69 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 15082 T69 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 15092 T69 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 15547 T69 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 15548 T69 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 15549 T69 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 15556 T69 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 15560 T69 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 15635 T69 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 15647 T69 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 15658 T69 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 15665 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 15667 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 15668 T69 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 15686 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 15687 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 15688 T69 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 15688 T69 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1381898792859/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/control/data/
   [junit4]   2> 15689 T69 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d525d52
   [junit4]   2> 15693 T69 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/control/data
   [junit4]   2> 15694 T69 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/control/data/index/
   [junit4]   2> 15695 T69 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 15696 T69 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/control/data/index
   [junit4]   2> 15697 T69 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 15698 T69 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2a182a18 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1cd91cd9),segFN=segments_1,generation=1}
   [junit4]   2> 15699 T69 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 15714 T69 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 15715 T69 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 15716 T69 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 15716 T69 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 15717 T69 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 15718 T69 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 15719 T69 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 15720 T69 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 15721 T69 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 15724 T69 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 15726 T69 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 15727 T69 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 15728 T69 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 15730 T69 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 15731 T69 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 15733 T69 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 15738 T69 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 15739 T69 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 15741 T69 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1786262556, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 15742 T69 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2a182a18 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1cd91cd9),segFN=segments_1,generation=1}
   [junit4]   2> 15743 T69 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 15744 T69 oass.SolrIndexSearcher.<init> Opening Searcher@ee80ee8 main
   [junit4]   2> 15758 T70 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ee80ee8 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 15768 T69 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 15769 T69 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37740 collection:control_collection shard:shard1
   [junit4]   2> 15772 T69 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
   [junit4]   2> 15775 T69 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 15808 T69 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 15817 T69 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 15818 T69 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 15819 T69 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37740/collection1/
   [junit4]   2> 15820 T69 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 15821 T69 oasc.SyncStrategy.syncToMe http://127.0.0.1:37740/collection1/ has no replicas
   [junit4]   2> 15821 T69 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37740/collection1/ shard1
   [junit4]   2> 15822 T69 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 16020 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 16078 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 16106 T69 oasc.ZkController.register We are http://127.0.0.1:37740/collection1/ and leader is http://127.0.0.1:37740/collection1/
   [junit4]   2> 16107 T69 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37740
   [junit4]   2> 16108 T69 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 16108 T69 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 16109 T69 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 16160 T69 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 16164 T41 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 16165 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 16175 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 16183 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:
   [junit4]   2> 16187 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16190 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e7e7e7e name:ZooKeeperConnection Watcher:127.0.0.1:59819/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16191 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16203 T41 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 16216 T41 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
   [junit4]   2> 16486 T41 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 16490 T41 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41067
   [junit4]   2> 16492 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 16493 T41 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 16495 T41 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900
   [junit4]   2> 16496 T41 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/'
   [junit4]   2> 16516 T41 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/solr.xml
   [junit4]   2> 16585 T41 oasc.CoreContainer.<init> New CoreContainer 462953368
   [junit4]   2> 16586 T41 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/]
   [junit4]   2> 16589 T41 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 16590 T41 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 16591 T41 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 16592 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 16593 T41 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 16595 T41 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 16596 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 16597 T41 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 16598 T41 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 16600 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 16602 T41 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 16604 T41 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 16606 T41 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59819/solr
   [junit4]   2> 16608 T41 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 16610 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16613 T84 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c251c25 name:ZooKeeperConnection Watcher:127.0.0.1:59819 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16613 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16618 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 16621 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16624 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12c012c0 name:ZooKeeperConnection Watcher:127.0.0.1:59819/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16625 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16639 T41 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 17649 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 17652 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:37740",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:37740_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 17656 T41 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41067_
   [junit4]   2> 17660 T41 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41067_
   [junit4]   2> 17672 T73 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 17673 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17680 T86 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 17681 T86 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17704 T66 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 17705 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17724 T87 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 17725 T87 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 17732 T87 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 19203 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 19206 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41067",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:41067_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 19207 T67 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 19207 T67 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 19220 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 19221 T86 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 19221 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 19733 T87 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 19734 T87 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/collection1
   [junit4]   2> 19734 T87 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 19737 T87 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 19738 T87 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 19743 T87 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/collection1/'
   [junit4]   2> 19745 T87 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/collection1/lib/classes/' to classloader
   [junit4]   2> 19746 T87 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/collection1/lib/README' to classloader
   [junit4]   2> 19804 T87 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 19875 T87 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 19881 T87 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 19889 T87 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 20339 T87 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 20339 T87 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 20340 T87 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 20346 T87 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 20350 T87 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 20405 T87 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 20413 T87 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 20421 T87 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 20425 T87 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 20426 T87 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 20427 T87 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 20437 T87 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 20438 T87 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 20438 T87 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 20439 T87 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1381898796900/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty1/
   [junit4]   2> 20440 T87 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d525d52
   [junit4]   2> 20442 T87 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty1
   [junit4]   2> 20442 T87 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty1/index/
   [junit4]   2> 20443 T87 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 20444 T87 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty1/index
   [junit4]   2> 20444 T87 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 20446 T87 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4b204b20 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2cbe2cbe),segFN=segments_1,generation=1}
   [junit4]   2> 20447 T87 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 20462 T87 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 20463 T87 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 20463 T87 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 20464 T87 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 20464 T87 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 20465 T87 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 20466 T87 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 20467 T87 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 20467 T87 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 20469 T87 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 20470 T87 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 20471 T87 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 20472 T87 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 20474 T87 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 20475 T87 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 20476 T87 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 20480 T87 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 20481 T87 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 20483 T87 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1786262556, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 20484 T87 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4b204b20 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2cbe2cbe),segFN=segments_1,generation=1}
   [junit4]   2> 20485 T87 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 20486 T87 oass.SolrIndexSearcher.<init> Opening Searcher@5d355d35 main
   [junit4]   2> 20497 T88 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d355d35 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 20504 T87 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 20504 T87 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41067 collection:collection1 shard:shard1
   [junit4]   2> 20505 T87 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
   [junit4]   2> 20510 T87 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 20542 T87 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 20551 T87 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 20552 T87 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 20553 T87 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41067/collection1/
   [junit4]   2> 20553 T87 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 20554 T87 oasc.SyncStrategy.syncToMe http://127.0.0.1:41067/collection1/ has no replicas
   [junit4]   2> 20554 T87 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41067/collection1/ shard1
   [junit4]   2> 20555 T87 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 20781 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 20814 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 20814 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 20815 T86 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 20828 T87 oasc.ZkController.register We are http://127.0.0.1:41067/collection1/ and leader is http://127.0.0.1:41067/collection1/
   [junit4]   2> 20829 T87 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41067
   [junit4]   2> 20830 T87 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 20831 T87 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 20839 T87 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 20846 T87 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 20850 T41 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 20851 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 20852 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 21044 T41 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 21047 T41 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49878
   [junit4]   2> 21049 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 21049 T41 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 21051 T41 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537
   [junit4]   2> 21051 T41 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/'
   [junit4]   2> 21065 T41 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/solr.xml
   [junit4]   2> 21121 T41 oasc.CoreContainer.<init> New CoreContainer 1168459173
   [junit4]   2> 21121 T41 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/]
   [junit4]   2> 21123 T41 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 21124 T41 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 21125 T41 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 21125 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 21126 T41 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 21127 T41 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 21128 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 21128 T41 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 21129 T41 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 21130 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 21132 T41 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 21133 T41 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 21135 T41 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59819/solr
   [junit4]   2> 21136 T41 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 21137 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 21141 T100 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44054405 name:ZooKeeperConnection Watcher:127.0.0.1:59819 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 21142 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 21148 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 21151 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 21154 T102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cb21cb2 name:ZooKeeperConnection Watcher:127.0.0.1:59819/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 21155 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 21179 T41 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 22191 T41 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49878_
   [junit4]   2> 22194 T41 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49878_
   [junit4]   2> 22206 T73 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 22206 T66 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 22209 T86 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 22211 T102 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 22271 T103 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 22272 T103 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 22276 T103 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 22349 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 22353 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41067",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:41067_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 22368 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49878",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49878_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 22369 T67 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 22369 T67 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 22382 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 22383 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 22383 T86 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 22382 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 23276 T103 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 23277 T103 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/collection1
   [junit4]   2> 23278 T103 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 23280 T103 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 23280 T103 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 23284 T103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/collection1/'
   [junit4]   2> 23286 T103 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/collection1/lib/classes/' to classloader
   [junit4]   2> 23287 T103 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/collection1/lib/README' to classloader
   [junit4]   2> 23342 T103 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 23384 T103 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 23388 T103 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 23400 T103 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 23872 T103 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 23873 T103 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 23874 T103 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 23880 T103 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 23883 T103 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 23933 T103 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 23941 T103 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 23949 T103 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 23953 T103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 23953 T103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 23954 T103 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 23958 T103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 23959 T103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 23959 T103 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 23960 T103 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1381898801537/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty2/
   [junit4]   2> 23961 T103 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d525d52
   [junit4]   2> 23963 T103 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty2
   [junit4]   2> 23963 T103 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty2/index/
   [junit4]   2> 23964 T103 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 23964 T103 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty2/index
   [junit4]   2> 23965 T103 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 23967 T103 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@200a200a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18241824),segFN=segments_1,generation=1}
   [junit4]   2> 23967 T103 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 23986 T103 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 23987 T103 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 23987 T103 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 23988 T103 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 23988 T103 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 23989 T103 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 23990 T103 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 23991 T103 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 23991 T103 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 23993 T103 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 23994 T103 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 23995 T103 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 23996 T103 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 23998 T103 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 24000 T103 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 24003 T103 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 24009 T103 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 24010 T103 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 24012 T103 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1786262556, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 24013 T103 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@200a200a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18241824),segFN=segments_1,generation=1}
   [junit4]   2> 24013 T103 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 24014 T103 oass.SolrIndexSearcher.<init> Opening Searcher@76087608 main
   [junit4]   2> 24025 T104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76087608 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 24031 T103 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 24032 T103 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49878 collection:collection1 shard:shard2
   [junit4]   2> 24033 T103 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
   [junit4]   2> 24036 T103 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 24064 T103 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 24073 T103 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 24074 T103 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 24075 T103 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49878/collection1/
   [junit4]   2> 24075 T103 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 24076 T103 oasc.SyncStrategy.syncToMe http://127.0.0.1:49878/collection1/ has no replicas
   [junit4]   2> 24077 T103 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49878/collection1/ shard2
   [junit4]   2> 24078 T103 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 25438 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 25523 T86 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 25523 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 25523 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 25526 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 25549 T103 oasc.ZkController.register We are http://127.0.0.1:49878/collection1/ and leader is http://127.0.0.1:49878/collection1/
   [junit4]   2> 25550 T103 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49878
   [junit4]   2> 25550 T103 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 25551 T103 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 25551 T103 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 25558 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 25563 T41 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 25564 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 25567 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 25784 T41 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 25787 T41 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60978
   [junit4]   2> 25789 T41 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 25789 T41 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 25790 T41 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254
   [junit4]   2> 25791 T41 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/'
   [junit4]   2> 25805 T41 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/solr.xml
   [junit4]   2> 25849 T41 oasc.CoreContainer.<init> New CoreContainer 1885630564
   [junit4]   2> 25850 T41 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/]
   [junit4]   2> 25852 T41 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 25852 T41 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 25853 T41 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 25854 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 25855 T41 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 25855 T41 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 25856 T41 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 25857 T41 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 25857 T41 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 25858 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
   [junit4]   2> 25860 T41 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 25861 T41 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 25862 T41 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59819/solr
   [junit4]   2> 25863 T41 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 25865 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 25868 T116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10f410f4 name:ZooKeeperConnection Watcher:127.0.0.1:59819 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 25868 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 25878 T41 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
   [junit4]   2> 25881 T41 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 25884 T118 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c810c81 name:ZooKeeperConnection Watcher:127.0.0.1:59819/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 25884 T41 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 25897 T41 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 26911 T41 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60978_
   [junit4]   2> 26913 T41 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60978_
   [junit4]   2> 26963 T86 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 26963 T118 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 26965 T66 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 26968 T73 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 26968 T102 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 26983 T119 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 26983 T119 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 26986 T119 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 27048 T67 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 27051 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49878",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49878_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 27100 T67 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:60978",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60978_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node3"}
   [junit4]   2> 27100 T67 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 27101 T67 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 27117 T86 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 27118 T66 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 27118 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 27119 T118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 27119 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 27987 T119 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 27988 T119 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/collection1
   [junit4]   2> 27989 T119 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 27992 T119 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 27993 T119 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 27999 T119 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/collection1/'
   [junit4]   2> 28001 T119 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/collection1/lib/classes/' to classloader
   [junit4]   2> 28003 T119 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/collection1/lib/README' to classloader
   [junit4]   2> 28084 T119 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 28182 T119 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 28186 T119 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 28200 T119 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 28741 T119 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 28742 T119 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 28743 T119 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 28749 T119 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 28752 T119 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 28822 T119 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 28831 T119 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 28841 T119 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 28857 T119 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 28858 T119 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 28859 T119 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 28865 T119 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 28866 T119 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 28867 T119 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 28868 T119 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1381898806254/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty3/
   [junit4]   2> 28869 T119 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d525d52
   [junit4]   2> 28875 T119 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty3
   [junit4]   2> 28879 T119 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty3/index/
   [junit4]   2> 28892 T119 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty3/index' doesn't exist. Creating new index...
   [junit4]   2> 28893 T119 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1381898792315/jetty3/index
   [junit4]   2> 28895 T119 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 28899 T119 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@25e225e2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5a765a76),segFN=segments_1,generation=1}
   [junit4]   2> 28900 T119 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 28925 T119 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 28926 T119 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 28927 T119 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 28928 T119 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 28929 T119 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 28930 T119 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 28931 T119 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 28932 T119 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 28933 T119 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 28935 T119 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 28937 T119 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 28938 T119 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 28939 T119 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 28941 T119 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 28943 T119 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 28951 T119 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 28965 T119 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 28966 T119 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 28968 T119 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1786262556, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 28970 T119 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@25e225e2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5a765a76),segFN=segments_1,generation=1}
   [junit4]   2> 28971 T119 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 28972 T119 oass.SolrIndexSearcher.<init> Opening Searcher@55395539 main
   [junit4]   2> 28984 T120 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55395539 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 29011 T119 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 29011 T119 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60978 collection:collection1 shard:shard1
   [junit4]   2> 29012 T119 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
   [junit4]   2> 29048 T119 oasc.ZkController.register We are http://127.0.0.1:60978/collection1/ and leader is http://127.0.0.1:41067/collection1/
   [junit4]   2> 29049 T119 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60978
   [junit4]   2> 29050 T119 oasc.ZkController.checkRecovery Core needs to recover:collection1
   [junit4]   2> 29051 T119 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
   [junit4]   2> 29063 T119 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@40de40de url=http://127.0.0.1:60978/collection1 node=127.0.0.1:60978_ C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:60978, core=collection1, node_name=127.0.0.1:60978_}
   [junit4]   2> 29064 T121 C2 P60978 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
   [junit4]   2> 29065 T121 C2 P60978 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
   [junit4]   2> 29066 T121 C2 P60978 oasc.ZkController.publish publishing core=collection1 state=recovering
   [junit4]   2> 29067 T121 C2 P60978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 29067 T41 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 29069 T41 oass.So

[...truncated too long message...]

rs (1)
   [junit4]   1>      /solr/collections/onenodecollection/leaders/shard1 (0)
   [junit4]   1>      DATA:
   [junit4]   1>          {
   [junit4]   1>            "base_url":"http://127.0.0.1:41067",
   [junit4]   1>            "node_name":"127.0.0.1:41067_",
   [junit4]   1>            "core":"onenodecollectioncore"}
   [junit4]   1>   /solr/aliases.json (0)
   [junit4]   1>   /solr/live_nodes (5)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:49878_ (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:41067_ (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:54448_ (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:60978_ (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:37740_ (0)
   [junit4]   1>   /solr/clusterstate.json (0)
   [junit4]   1>   DATA:
   [junit4]   1>       {
   [junit4]   1>         "control_collection":{
   [junit4]   1>           "shards":{"shard1":{
   [junit4]   1>               "range":"80000000-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{"core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:37740",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:37740_",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "replicationFactor":"1"},
   [junit4]   1>         "onenodecollection":{
   [junit4]   1>           "shards":{"shard1":{
   [junit4]   1>               "range":"80000000-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{"core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:41067",
   [junit4]   1>                   "core":"onenodecollectioncore",
   [junit4]   1>                   "roles":"none",
   [junit4]   1>                   "node_name":"127.0.0.1:41067_",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "replicationFactor":"1"},
   [junit4]   1>         "collection1":{
   [junit4]   1>           "shards":{
   [junit4]   1>             "shard1":{
   [junit4]   1>               "range":"80000000-ffffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:41067",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:41067_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node3":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:60978",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:60978_"}}},
   [junit4]   1>             "shard2":{
   [junit4]   1>               "range":"0-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node2":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:49878",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:49878_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node4":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:54448",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:54448_"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "replicationFactor":"1"}}
   [junit4]   1>  /zookeeper (1)
   [junit4]   1>  DATA:
   [junit4]   1>      
   [junit4]   1> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=96CB96B7D447A9C2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lt_LT_PREEURO -Dtests.timezone=Africa/Kinshasa -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   37.1s J1 | BasicDistributedZk2Test.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 404 Can not find: /onenodecollectioncore/update</title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 404</h2>
   [junit4]    > <p>Problem accessing /onenodecollectioncore/update. Reason:
   [junit4]    > <pre>    Can not find: /onenodecollectioncore/update</pre></p>
   [junit4]    > <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([96CB96B7D447A9C2:172D18AFA318C9FE]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:428)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
   [junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:738)
   [junit4]   2> 48756 T41 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 37156 T40 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
   [junit4]   2> 48781 T118 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 49925 T135 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=lt_LT_PREEURO, timezone=Africa/Kinshasa
   [junit4]   2> NOTE: Linux 3.8.0-31-generic x86/IBM Corporation 1.6.0 (32-bit)/cpus=8,threads=3,free=301232,total=26317312
   [junit4]   2> NOTE: All tests run in this JVM: [JSONWriterTest, PreAnalyzedFieldTest, TestAtomicUpdateErrorCases, TestDefaultSimilarityFactory, BasicDistributedZk2Test]
   [junit4] Completed on J1 in 38.47s, 1 test, 1 error <<< FAILURES!

[...truncated 955 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:428: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:421: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:483: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1263: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:906: There were test failures: 327 suites, 1453 tests, 1 error, 35 ignored (6 assumptions)

Total time: 51 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure