You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/10/19 12:47:49 UTC

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1691 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1691/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:34693/euf/collection1 Dead Guy:http://127.0.0.1:30783/euf/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:36723/euf/collection1], CloudJettyRunner [url=http://127.0.0.1:36723/euf/collection1]]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:34693/euf/collection1 Dead Guy:http://127.0.0.1:30783/euf/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:36723/euf/collection1], CloudJettyRunner [url=http://127.0.0.1:36723/euf/collection1]]
	at __randomizedtesting.SeedInfo.seed([6205EB88A844D532:E3E36590DF1BB50E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:216)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 9948 lines...]
   [junit4] Suite: org.apache.solr.cloud.SyncSliceTest
   [junit4]   2> 772246 T2113 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /euf/
   [junit4]   2> 772253 T2113 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1382178378960
   [junit4]   2> 772255 T2113 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 772256 T2114 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 772358 T2113 oasc.ZkTestServer.run start zk server on port:54844
   [junit4]   2> 772359 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 772363 T2120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@92a3450 name:ZooKeeperConnection Watcher:127.0.0.1:54844 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 772364 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 772364 T2113 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 772378 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 772380 T2122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74dc7b1e name:ZooKeeperConnection Watcher:127.0.0.1:54844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 772381 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 772381 T2113 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 772391 T2113 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 772393 T2113 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 772396 T2113 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 772399 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 772399 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 772410 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 772411 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 772516 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 772516 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 772519 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 772520 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 772523 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 772524 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 772531 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 772532 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 772535 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 772536 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 772538 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 772539 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 772542 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 772543 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 772550 T2113 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 772551 T2113 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 772835 T2113 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 772842 T2113 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48022
   [junit4]   2> 772842 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 772843 T2113 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 772843 T2113 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261
   [junit4]   2> 772844 T2113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/'
   [junit4]   2> 772884 T2113 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/solr.xml
   [junit4]   2> 772977 T2113 oasc.CoreContainer.<init> New CoreContainer 957956409
   [junit4]   2> 772978 T2113 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/]
   [junit4]   2> 772980 T2113 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 772980 T2113 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 772981 T2113 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 772981 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 772982 T2113 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 772982 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 772983 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 772983 T2113 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 772984 T2113 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 772990 T2113 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 772991 T2113 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 772992 T2113 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54844/solr
   [junit4]   2> 772992 T2113 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 772993 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 772996 T2133 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@91e7572 name:ZooKeeperConnection Watcher:127.0.0.1:54844 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 772997 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 773010 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 773012 T2135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76984536 name:ZooKeeperConnection Watcher:127.0.0.1:54844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 773012 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 773014 T2113 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 773025 T2113 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 773029 T2113 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 773032 T2113 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48022_euf
   [junit4]   2> 773039 T2113 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48022_euf
   [junit4]   2> 773042 T2113 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 773059 T2113 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 773062 T2113 oasc.Overseer.start Overseer (id=90582442244046851-127.0.0.1:48022_euf-n_0000000000) starting
   [junit4]   2> 773071 T2113 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 773082 T2137 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 773082 T2113 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 773089 T2113 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 773091 T2113 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 773094 T2136 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 773100 T2138 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 773100 T2138 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 773101 T2138 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 774598 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 774599 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:48022/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:48022_euf",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 774600 T2136 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 774600 T2136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 774616 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 775105 T2138 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 775105 T2138 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/collection1
   [junit4]   2> 775105 T2138 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 775106 T2138 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 775106 T2138 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 775107 T2138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/collection1/'
   [junit4]   2> 775109 T2138 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/collection1/lib/classes/' to classloader
   [junit4]   2> 775110 T2138 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/collection1/lib/README' to classloader
   [junit4]   2> 775177 T2138 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 775245 T2138 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 775348 T2138 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 775361 T2138 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 776050 T2138 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 776052 T2138 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 776053 T2138 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 776066 T2138 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 776070 T2138 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 776084 T2138 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 776089 T2138 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 776094 T2138 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 776095 T2138 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 776095 T2138 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 776095 T2138 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 776096 T2138 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 776097 T2138 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 776097 T2138 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 776097 T2138 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1382178379261/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1382178378960/control/data/
   [junit4]   2> 776098 T2138 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32737d8a
   [junit4]   2> 776099 T2138 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/control/data
   [junit4]   2> 776099 T2138 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1382178378960/control/data/index/
   [junit4]   2> 776099 T2138 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1382178378960/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 776100 T2138 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/control/data/index
   [junit4]   2> 776100 T2138 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=12, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 776101 T2138 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@27061467 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7cfa0dff),segFN=segments_1,generation=1}
   [junit4]   2> 776102 T2138 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 776105 T2138 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 776106 T2138 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 776106 T2138 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 776107 T2138 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 776107 T2138 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 776107 T2138 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 776108 T2138 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 776108 T2138 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 776109 T2138 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 776109 T2138 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 776110 T2138 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 776110 T2138 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 776111 T2138 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 776111 T2138 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 776112 T2138 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 776128 T2138 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 776135 T2138 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 776135 T2138 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 776136 T2138 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=71.0517578125, floorSegmentMB=1.36328125, forceMergeDeletesPctAllowed=19.247041117879416, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 776137 T2138 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@27061467 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7cfa0dff),segFN=segments_1,generation=1}
   [junit4]   2> 776137 T2138 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 776137 T2138 oass.SolrIndexSearcher.<init> Opening Searcher@1222f8c2 main
   [junit4]   2> 776141 T2139 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1222f8c2 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 776143 T2138 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 776144 T2138 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48022/euf collection:control_collection shard:shard1
   [junit4]   2> 776145 T2138 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 776193 T2138 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 776205 T2138 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 776206 T2138 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 776206 T2138 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48022/euf/collection1/
   [junit4]   2> 776206 T2138 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 776206 T2138 oasc.SyncStrategy.syncToMe http://127.0.0.1:48022/euf/collection1/ has no replicas
   [junit4]   2> 776207 T2138 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48022/euf/collection1/ shard1
   [junit4]   2> 776207 T2138 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 777623 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 777644 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 777703 T2138 oasc.ZkController.register We are http://127.0.0.1:48022/euf/collection1/ and leader is http://127.0.0.1:48022/euf/collection1/
   [junit4]   2> 777703 T2138 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48022/euf
   [junit4]   2> 777703 T2138 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 777703 T2138 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 777704 T2138 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 777705 T2138 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 777706 T2113 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 777707 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 777710 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 777712 T2142 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c5ad030 name:ZooKeeperConnection Watcher:127.0.0.1:54844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 777712 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 777715 T2113 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 777717 T2113 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
   [junit4]   2> 778004 T2113 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 778006 T2113 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30783
   [junit4]   2> 778007 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 778007 T2113 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 778008 T2113 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423
   [junit4]   2> 778008 T2113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/'
   [junit4]   2> 778049 T2113 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/solr.xml
   [junit4]   2> 778140 T2113 oasc.CoreContainer.<init> New CoreContainer 1897754413
   [junit4]   2> 778141 T2113 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/]
   [junit4]   2> 778143 T2113 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 778143 T2113 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 778144 T2113 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 778144 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 778145 T2113 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 778145 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 778146 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 778146 T2113 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 778147 T2113 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 778153 T2113 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 778154 T2113 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 778155 T2113 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54844/solr
   [junit4]   2> 778155 T2113 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 778156 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 778159 T2153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5748dd5b name:ZooKeeperConnection Watcher:127.0.0.1:54844 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 778160 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 778178 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 778180 T2155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a7d1d14 name:ZooKeeperConnection Watcher:127.0.0.1:54844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 778180 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 778191 T2113 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 779156 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 779157 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:48022/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:48022_euf",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 779176 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 779176 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 779176 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 779195 T2113 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30783_euf
   [junit4]   2> 779197 T2113 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30783_euf
   [junit4]   2> 779199 T2142 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 779200 T2155 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 779199 T2135 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 779215 T2156 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 779215 T2156 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 779217 T2156 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 780683 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 780684 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:30783/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:30783_euf",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 780684 T2136 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 780685 T2136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 780704 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 780704 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 780704 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 781219 T2156 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 781219 T2156 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/collection1
   [junit4]   2> 781219 T2156 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 781220 T2156 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 781220 T2156 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 781221 T2156 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/collection1/'
   [junit4]   2> 781223 T2156 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/collection1/lib/classes/' to classloader
   [junit4]   2> 781223 T2156 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/collection1/lib/README' to classloader
   [junit4]   2> 781290 T2156 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 781356 T2156 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 781457 T2156 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 781469 T2156 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 782152 T2156 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 782153 T2156 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 782154 T2156 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 782167 T2156 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 782172 T2156 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 782186 T2156 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 782191 T2156 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 782196 T2156 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 782197 T2156 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 782197 T2156 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 782197 T2156 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 782198 T2156 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 782198 T2156 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 782199 T2156 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 782199 T2156 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.SyncSliceTest-jetty1-1382178384423/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty1/
   [junit4]   2> 782200 T2156 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32737d8a
   [junit4]   2> 782201 T2156 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty1
   [junit4]   2> 782201 T2156 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty1/index/
   [junit4]   2> 782201 T2156 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 782202 T2156 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty1/index
   [junit4]   2> 782202 T2156 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=12, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 782203 T2156 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@516b64ad lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40dcf3a3),segFN=segments_1,generation=1}
   [junit4]   2> 782204 T2156 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 782208 T2156 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 782209 T2156 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 782209 T2156 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 782209 T2156 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 782210 T2156 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 782210 T2156 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 782211 T2156 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 782211 T2156 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 782211 T2156 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 782212 T2156 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 782213 T2156 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 782213 T2156 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 782214 T2156 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 782214 T2156 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 782215 T2156 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 782231 T2156 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 782237 T2156 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 782237 T2156 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 782238 T2156 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=71.0517578125, floorSegmentMB=1.36328125, forceMergeDeletesPctAllowed=19.247041117879416, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 782239 T2156 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@516b64ad lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40dcf3a3),segFN=segments_1,generation=1}
   [junit4]   2> 782239 T2156 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 782240 T2156 oass.SolrIndexSearcher.<init> Opening Searcher@3d7c64cb main
   [junit4]   2> 782245 T2157 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d7c64cb main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 782247 T2156 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 782248 T2156 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30783/euf collection:collection1 shard:shard1
   [junit4]   2> 782249 T2156 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 782270 T2156 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 782272 T2156 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 782272 T2156 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 782273 T2156 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30783/euf/collection1/
   [junit4]   2> 782273 T2156 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 782273 T2156 oasc.SyncStrategy.syncToMe http://127.0.0.1:30783/euf/collection1/ has no replicas
   [junit4]   2> 782273 T2156 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30783/euf/collection1/ shard1
   [junit4]   2> 782274 T2156 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 783711 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 783730 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 783730 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 783730 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 783768 T2156 oasc.ZkController.register We are http://127.0.0.1:30783/euf/collection1/ and leader is http://127.0.0.1:30783/euf/collection1/
   [junit4]   2> 783768 T2156 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30783/euf
   [junit4]   2> 783768 T2156 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 783768 T2156 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 783769 T2156 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 783771 T2156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 783772 T2113 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 783772 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 784060 T2113 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 784063 T2113 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36723
   [junit4]   2> 784064 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 784064 T2113 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 784065 T2113 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480
   [junit4]   2> 784065 T2113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/'
   [junit4]   2> 784106 T2113 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/solr.xml
   [junit4]   2> 784197 T2113 oasc.CoreContainer.<init> New CoreContainer 1907384160
   [junit4]   2> 784198 T2113 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/]
   [junit4]   2> 784200 T2113 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 784201 T2113 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 784201 T2113 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 784201 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 784202 T2113 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 784202 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 784203 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 784203 T2113 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 784204 T2113 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 784211 T2113 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 784211 T2113 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 784212 T2113 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54844/solr
   [junit4]   2> 784212 T2113 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 784214 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 784217 T2169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@621cc396 name:ZooKeeperConnection Watcher:127.0.0.1:54844 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 784217 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 784234 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 784236 T2171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d0227c3 name:ZooKeeperConnection Watcher:127.0.0.1:54844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 784236 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 784246 T2113 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 785235 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 785236 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:30783/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:30783_euf",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 785285 T2113 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36723_euf
   [junit4]   2> 785317 T2113 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36723_euf
   [junit4]   2> 785318 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 785318 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 785318 T2171 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 785318 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 785375 T2155 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 785376 T2171 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 785376 T2142 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 785376 T2135 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 785408 T2172 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 785409 T2172 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 785436 T2172 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 786878 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 786879 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36723/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:36723_euf",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 786879 T2136 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
   [junit4]   2> 786880 T2136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 786903 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 786903 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 786903 T2171 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 786903 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 787441 T2172 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 787441 T2172 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/collection1
   [junit4]   2> 787441 T2172 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 787442 T2172 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 787442 T2172 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 787443 T2172 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/collection1/'
   [junit4]   2> 787445 T2172 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/collection1/lib/classes/' to classloader
   [junit4]   2> 787446 T2172 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/collection1/lib/README' to classloader
   [junit4]   2> 787513 T2172 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 787578 T2172 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 787680 T2172 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 787692 T2172 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 788370 T2172 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 788371 T2172 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 788372 T2172 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 788385 T2172 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 788389 T2172 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 788402 T2172 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 788407 T2172 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 788412 T2172 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 788413 T2172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 788413 T2172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 788414 T2172 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 788414 T2172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 788415 T2172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 788415 T2172 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 788416 T2172 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1382178390480/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty2/
   [junit4]   2> 788416 T2172 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32737d8a
   [junit4]   2> 788417 T2172 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty2
   [junit4]   2> 788417 T2172 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty2/index/
   [junit4]   2> 788418 T2172 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 788418 T2172 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty2/index
   [junit4]   2> 788419 T2172 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=12, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 788420 T2172 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2b6d99f5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@24ba17c),segFN=segments_1,generation=1}
   [junit4]   2> 788420 T2172 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 788424 T2172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 788425 T2172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 788425 T2172 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 788426 T2172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 788426 T2172 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 788426 T2172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 788427 T2172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 788427 T2172 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 788428 T2172 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 788429 T2172 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 788429 T2172 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 788430 T2172 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 788430 T2172 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 788431 T2172 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 788431 T2172 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 788448 T2172 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 788453 T2172 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 788454 T2172 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 788455 T2172 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=71.0517578125, floorSegmentMB=1.36328125, forceMergeDeletesPctAllowed=19.247041117879416, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 788455 T2172 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2b6d99f5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@24ba17c),segFN=segments_1,generation=1}
   [junit4]   2> 788456 T2172 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 788456 T2172 oass.SolrIndexSearcher.<init> Opening Searcher@511abb4c main
   [junit4]   2> 788462 T2173 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@511abb4c main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 788464 T2172 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 788464 T2172 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36723/euf collection:collection1 shard:shard1
   [junit4]   2> 788468 T2172 oasc.ZkController.register We are http://127.0.0.1:36723/euf/collection1/ and leader is http://127.0.0.1:30783/euf/collection1/
   [junit4]   2> 788469 T2172 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36723/euf
   [junit4]   2> 788469 T2172 oasc.ZkController.checkRecovery Core needs to recover:collection1
   [junit4]   2> 788469 T2172 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
   [junit4]   2> ASYNC  NEW_CORE C832 name=collection1 org.apache.solr.core.SolrCore@9c2249a url=http://127.0.0.1:36723/euf/collection1 node=127.0.0.1:36723_euf C832_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:36723/euf, core=collection1, node_name=127.0.0.1:36723_euf}
   [junit4]   2> 788469 T2174 C832 P36723 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
   [junit4]   2> 788470 T2172 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 788470 T2174 C832 P36723 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
   [junit4]   2> 788470 T2174 C832 P36723 oasc.ZkController.publish publishing core=collection1 state=recovering
   [junit4]   2> 788471 T2174 C832 P36723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 788471 T2113 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 788472 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 788475 T2145 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
   [junit4]   2> 788752 T2113 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 788755 T2113 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34693
   [junit4]   2> 788756 T2113 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 788756 T2113 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 788757 T2113 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179
   [junit4]   2> 788757 T2113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/'
   [junit4]   2> 788797 T2113 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/solr.xml
   [junit4]   2> 788888 T2113 oasc.CoreContainer.<init> New CoreContainer 1949244404
   [junit4]   2> 788889 T2113 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/]
   [junit4]   2> 788891 T2113 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 788892 T2113 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 788892 T2113 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 788893 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 788893 T2113 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 788894 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 788894 T2113 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 788894 T2113 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 788895 T2113 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 788902 T2113 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 788902 T2113 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 788903 T2113 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54844/solr
   [junit4]   2> 788904 T2113 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 788905 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 788908 T2186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75ecaf09 name:ZooKeeperConnection Watcher:127.0.0.1:54844 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 788908 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 788924 T2113 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 788926 T2188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7838b91c name:ZooKeeperConnection Watcher:127.0.0.1:54844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 788926 T2113 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 788936 T2113 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 789910 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 789911 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36723/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:36723_euf",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 789930 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 789930 T2171 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 789930 T2188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 789930 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 789930 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 789939 T2113 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34693_euf
   [junit4]   2> 789941 T2113 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34693_euf
   [junit4]   2> 789944 T2142 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 789944 T2188 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 789944 T2171 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 789944 T2155 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 789944 T2135 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 789958 T2189 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 789958 T2189 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 789959 T2189 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 790480 T2145 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
   [junit4]   2> 790480 T2145 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:36723_euf&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005 
   [junit4]   2> 791436 T2136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 791437 T2136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:34693/euf",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:34693_euf",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node3"}
   [junit4]   2> 791437 T2136 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
   [junit4]   2> 791437 T2136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 791463 T2142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 791463 T2188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 791463 T2155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 791463 T2171 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 791463 T2135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 791962 T2189 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 791962 T2189 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/collection1
   [junit4]   2> 791962 T2189 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 791963 T2189 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 791964 T2189 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 791964 T2189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/collection1/'
   [junit4]   2> 791966 T2189 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/collection1/lib/README' to classloader
   [junit4]   2> 791967 T2189 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/collection1/lib/classes/' to classloader
   [junit4]   2> 792016 T2189 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_46
   [junit4]   2> 792065 T2189 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 792166 T2189 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 792175 T2189 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> ASYNC  NEW_CORE C833 name=collection1 org.apache.solr.core.SolrCore@9c2249a url=http://127.0.0.1:36723/euf/collection1 node=127.0.0.1:36723_euf C833_STATE=coll:collection1 core:collection1 props:{state=recovering, base_url=http://127.0.0.1:36723/euf, core=collection1, node_name=127.0.0.1:36723_euf}
   [junit4]   2> 792482 T2174 C833 P36723 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:30783/euf/collection1/ core=collection1 - recoveringAfterStartup=true
   [junit4]   2> 792482 T2174 C833 P36723 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36723/euf START replicas=[http://127.0.0.1:30783/euf/collection1/] nUpdates=100
   [junit4]   2> 792483 T2174 C833 P36723 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
   [junit4]   2> 792484 T2174 C833 P36723 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
   [junit4]   2> 792484 T2174 C833 P36723 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
   [junit4]   2> 792485 T2174 C833 P36723 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
   [junit4]   2> 792485 T2174 C833 P36723 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 792485 T2174 C833 P36723 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:30783/euf/collection1/. core=collection1
   [junit4]   2> ASYNC  NEW_CORE C834 name=collection1 org.apache.solr.core.SolrCore@3d71de06 url=http://127.0.0.1:30783/euf/collection1 node=127.0.0.1:30783_euf C834_STATE=coll:collection1 core:collection1 props:{state=active, base_url=http://127.0.0.1:30783/euf, core=collection1, node_name=127.0.0.1:30783_euf, leader=true}
   [junit4]   2> 792492 T2146 C834 P30783 oasc.SolrCore.execute [collection1] webapp=/euf path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
   [junit4]   2> 792494 T2147 C834 P30783 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 792495 T2147 C834 P30783 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 792495 T2147 C834 P30783 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 792495 T2147 C834 P30783 oasup.LogUpdateProcessor.finish [collection1] webapp=/euf path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
   [junit4]   2> 792496 T2174 C833 P36723 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 792496 T2174 C833 P36723 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 792499 T2148 C834 P30783 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 792500 T2148 C834 P30783 oasc.SolrCore.execute [collection1] webapp=/euf path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
   [junit4]   2> 792501 T2174 C833 P36723 oasc.RecoveryStrategy.replay No replay needed. core=collection1
   [junit4]   2> 792501 T2174 C833 P36723 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
   [junit4]   2> 792501 T2174 C833 P36723 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 792501 T2174 C833 P36723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 792503 T2174 C833 P36723 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
   [junit4]   2> 792750 T2189 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 792751 T2189 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 792751 T2189 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 792762 T2189 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 792766 T2189 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 792777 T2189 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 792781 T2189 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 792789 T2189 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 792790 T2189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 792791 T2189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 792791 T2189 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 792792 T2189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 792792 T2189 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 792792 T2189 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 792793 T2189 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.SyncSliceTest-jetty3-1382178395179/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty3/
   [junit4]   2> 792793 T2189 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32737d8a
   [junit4]   2> 792794 T2189 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty3
   [junit4]   2> 792794 T2189 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty3/index/
   [junit4]   2> 792794 T2189 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty3/index' doesn't exist. Creating new index...
   [junit4]   2> 792795 T2189 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1382178378960/jetty3/index
   [junit4]   2> 792795 T2189 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=12, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 792796 T2189 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2949d8ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e9b2ec8),segFN=segments_1,generation=1}
   [junit4]   2> 792796 T2189 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 792800 T2189 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 792800 T2189 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 792800 T2189 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 792801 T2189 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 792801 T2189 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 792801 T2189 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 792802 T2189 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 792802 T2189 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 792802 T2189 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 792803 T2189 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 792803 T2189 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 792804 T2189 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 792804 T2189 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 792805 T2189 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 792805 T2189 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 792819 T2189 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 792824 T2189 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 792824 T2189 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 792825 T2189 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=71.0517578125, floorSegmentMB=1.36328125, forceMergeDeletesPctAllowed=19.247041117879416, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 792825 T2189 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store

[...truncated too long message...]

core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:36723_euf"},
   [junit4]   1>                 "core_node3":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:34693/euf",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:34693_euf",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node4":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:50316/euf",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:50316_euf"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "replicationFactor":"1"},
   [junit4]   1>         "control_collection":{
   [junit4]   1>           "shards":{"shard1":{
   [junit4]   1>               "range":"80000000-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{"core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:48022/euf",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:48022_euf",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "replicationFactor":"1"}}
   [junit4]   1>   /solr/aliases.json (0)
   [junit4]   1>   /solr/live_nodes (5)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:30783_euf (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:50316_euf (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:34693_euf (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:48022_euf (0)
   [junit4]   1>    /solr/live_nodes/127.0.0.1:36723_euf (0)
   [junit4]   1>   /solr/overseer (3)
   [junit4]   1>   DATA:
   [junit4]   1>       
   [junit4]   1>    /solr/overseer/queue (0)
   [junit4]   1>    /solr/overseer/queue-work (0)
   [junit4]   1>    /solr/overseer/collection-queue-work (0)
   [junit4]   1>   /solr/collections (2)
   [junit4]   1>    /solr/collections/collection1 (3)
   [junit4]   1>    DATA:
   [junit4]   1>        {"configName":"conf1"}
   [junit4]   1>     /solr/collections/collection1/shards (0)
   [junit4]   1>     /solr/collections/collection1/leader_elect (1)
   [junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
   [junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (4)
   [junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/90582442244046862-core_node1-n_0000000005 (0)
   [junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/90582442244046856-core_node2-n_0000000004 (0)
   [junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/90582442244046858-core_node3-n_0000000002 (0)
   [junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/90582442244046860-core_node4-n_0000000003 (0)
   [junit4]   1>     /solr/collections/collection1/leaders (1)
   [junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
   [junit4]   1>      DATA:
   [junit4]   1>          {
   [junit4]   1>            "core":"collection1",
   [junit4]   1>            "node_name":"127.0.0.1:34693_euf",
   [junit4]   1>            "base_url":"http://127.0.0.1:34693/euf"}
   [junit4]   1>    /solr/collections/control_collection (3)
   [junit4]   1>    DATA:
   [junit4]   1>        {"configName":"conf1"}
   [junit4]   1>     /solr/collections/control_collection/shards (0)
   [junit4]   1>     /solr/collections/control_collection/leader_elect (1)
   [junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
   [junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
   [junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/90582442244046851-core_node1-n_0000000000 (0)
   [junit4]   1>     /solr/collections/control_collection/leaders (1)
   [junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
   [junit4]   1>      DATA:
   [junit4]   1>          {
   [junit4]   1>            "core":"collection1",
   [junit4]   1>            "node_name":"127.0.0.1:48022_euf",
   [junit4]   1>            "base_url":"http://127.0.0.1:48022/euf"}
   [junit4]   1>   /solr/overseer_elect (2)
   [junit4]   1>    /solr/overseer_elect/election (5)
   [junit4]   1>     /solr/overseer_elect/election/90582442244046858-127.0.0.1:34693_euf-n_0000000003 (0)
   [junit4]   1>     /solr/overseer_elect/election/90582442244046860-127.0.0.1:50316_euf-n_0000000004 (0)
   [junit4]   1>     /solr/overseer_elect/election/90582442244046856-127.0.0.1:36723_euf-n_0000000002 (0)
   [junit4]   1>     /solr/overseer_elect/election/90582442244046862-127.0.0.1:30783_euf-n_0000000005 (0)
   [junit4]   1>     /solr/overseer_elect/election/90582442244046851-127.0.0.1:48022_euf-n_0000000000 (0)
   [junit4]   1>    /solr/overseer_elect/leader (0)
   [junit4]   1>    DATA:
   [junit4]   1>        {"id":"90582442244046851-127.0.0.1:48022_euf-n_0000000000"}
   [junit4]   1>  /zookeeper (1)
   [junit4]   1>  DATA:
   [junit4]   1>      
   [junit4]   1> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=6205EB88A844D532 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_ME_#Latn -Dtests.timezone=America/Antigua -Dtests.file.encoding=UTF-8
   [junit4] FAILURE  116s J1 | SyncSliceTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:34693/euf/collection1 Dead Guy:http://127.0.0.1:30783/euf/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:36723/euf/collection1], CloudJettyRunner [url=http://127.0.0.1:36723/euf/collection1]]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6205EB88A844D532:E3E36590DF1BB50E]:0)
   [junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:216)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:724)
   [junit4]   2> 888340 T2113 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 116099 T2112 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> 888612 T2188 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 889682 T2206 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=sr_ME_#Latn, timezone=America/Antigua
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=315619984,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [TestIBSimilarityFactory, TestFastOutputStream, TestFieldTypeCollectionResource, TestSchemaResource, TestCloudManagedSchema, TestQueryUtils, DateFieldTest, TestCopyFieldCollectionResource, SuggesterTSTTest, TestSerializedLuceneMatchVersion, FastVectorHighlighterTest, SolrIndexSplitterTest, FieldAnalysisRequestHandlerTest, TestPHPSerializedResponseWriter, TestRandomFaceting, SolrCoreCheckLockOnStartupTest, StandardRequestHandlerTest, TestIndexSearcher, RecoveryZkTest, TestStressLucene, TestLMDirichletSimilarityFactory, TestSolrXmlPersistor, StatsComponentTest, HdfsChaosMonkeySafeLeaderTest, TestMaxScoreQueryParser, ParsingFieldUpdateProcessorsTest, TestJoin, TestFuzzyAnalyzedSuggestions, SignatureUpdateProcessorFactoryTest, TestDocumentBuilder, WordBreakSolrSpellCheckerTest, TestSystemIdResolver, StressHdfsTest, TestJmxMonitoredMap, ZkNodePropsTest, DistributedTermsComponentTest, TestReplicationHandler, CircularListTest, BinaryUpdateRequestHandlerTest, DistributedQueryElevationComponentTest, TestCSVResponseWriter, CustomCollectionTest, QueryElevationComponentTest, TestMergePolicyConfig, TestZkChroot, TestDynamicFieldResource, IndexBasedSpellCheckerTest, CacheHeaderTest, TestQuerySenderListener, HdfsBasicDistributedZk2Test, SyncSliceTest]
   [junit4] Completed on J1 in 117.64s, 1 test, 1 failure <<< FAILURES!

[...truncated 735 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:408: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:483: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1263: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:906: There were test failures: 327 suites, 1453 tests, 1 failure, 35 ignored (6 assumptions)

Total time: 58 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure