You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@sd-datasolutions.de> on 2012/12/02 08:25:26 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_09) - Build # 3014 - Failure!

Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux/3014/
Java: 32bit/jdk1.7.0_09 -client -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
ERROR: SolrIndexSearcher opens=1527 closes=1526

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1527 closes=1526
	at __randomizedtesting.SeedInfo.seed([AFD96FBECF210FAA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:243)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9127 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 4 T697 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1354432672224
[junit4:junit4]   2> 5 T697 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 5 T698 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 6 T698 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 6 T698 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 6 T698 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 7 T698 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 7 T698 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 105 T697 oasc.ZkTestServer.run start zk server on port:50485
[junit4:junit4]   2> 106 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f8da11
[junit4:junit4]   2> 107 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T703 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 107 T703 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 107 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37017
[junit4:junit4]   2> 108 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37017
[junit4:junit4]   2> 108 T701 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 192 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40000 with negotiated timeout 10000 for client /127.0.0.1:37017
[junit4:junit4]   2> 192 T703 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40000, negotiated timeout = 10000
[junit4:junit4]   2> 193 T704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f8da11 name:ZooKeeperConnection Watcher:127.0.0.1:50485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 193 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 193 T697 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 197 T702 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b5a7a71e40000
[junit4:junit4]   2> 198 T704 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 198 T699 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37017 which had sessionid 0x13b5a7a71e40000
[junit4:junit4]   2> 198 T697 oaz.ZooKeeper.close Session: 0x13b5a7a71e40000 closed
[junit4:junit4]   2> 199 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@bbf3b
[junit4:junit4]   2> 200 T705 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 200 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 201 T705 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 201 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37018
[junit4:junit4]   2> 201 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37018
[junit4:junit4]   2> 202 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40001 with negotiated timeout 10000 for client /127.0.0.1:37018
[junit4:junit4]   2> 202 T705 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40001, negotiated timeout = 10000
[junit4:junit4]   2> 203 T706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bbf3b name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 203 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 203 T697 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 206 T697 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 209 T697 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 211 T697 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 213 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 214 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 225 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 226 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 230 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 231 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 234 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 235 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 237 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 238 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 242 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 242 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 245 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 245 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 248 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 249 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 252 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 253 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 255 T697 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 256 T697 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 263 T702 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b5a7a71e40001
[junit4:junit4]   2> 263 T699 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37018 which had sessionid 0x13b5a7a71e40001
[junit4:junit4]   2> 264 T706 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 264 T697 oaz.ZooKeeper.close Session: 0x13b5a7a71e40001 closed
[junit4:junit4]   2> 349 T697 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 352 T697 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:36976
[junit4:junit4]   2> 353 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 354 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485
[junit4:junit4]   2> 355 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/'
[junit4:junit4]   2> 376 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 377 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 377 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485
[junit4:junit4]   2> 377 T697 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/solr.xml
[junit4:junit4]   2> 378 T697 oasc.CoreContainer.<init> New CoreContainer 387822
[junit4:junit4]   2> 378 T697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/'
[junit4:junit4]   2> 379 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/'
[junit4:junit4]   2> 403 T697 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 423 T697 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50485/solr
[junit4:junit4]   2> 424 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@ba195d
[junit4:junit4]   2> 425 T716 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 425 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 426 T716 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 426 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37020
[junit4:junit4]   2> 426 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37020
[junit4:junit4]   2> 427 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40002 with negotiated timeout 8000 for client /127.0.0.1:37020
[junit4:junit4]   2> 427 T716 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40002, negotiated timeout = 8000
[junit4:junit4]   2> 428 T717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba195d name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 428 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 430 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x2 zxid:0x19 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 430 T697 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 432 T697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36976_solr
[junit4:junit4]   2> 433 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:delete cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36976_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36976_solr
[junit4:junit4]   2> 434 T697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36976_solr
[junit4:junit4]   2> 436 T697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 437 T697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 437 T697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 437 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 438 T697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 438 T697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 439 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 439 T697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 440 T697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 449 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 453 T697 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 458 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:delete cxid:0x15 zxid:0x20 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 459 T697 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 461 T697 oasc.Overseer.start Overseer (id=88764099607134210-127.0.0.1:36976_solr-n_0000000000) starting
[junit4:junit4]   2> 462 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x1a zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 462 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 463 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 464 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 464 T719 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 466 T697 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 468 T697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 471 T718 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 474 T720 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/collection1
[junit4:junit4]   2> 474 T720 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 475 T720 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 475 T720 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 477 T720 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/collection1/'
[junit4:junit4]   2> 477 T720 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/collection1/lib/README' to classloader
[junit4:junit4]   2> 478 T720 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 540 T720 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 671 T720 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 672 T720 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 685 T720 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1544 T720 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1558 T720 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1561 T720 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1573 T720 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1584 T720 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1587 T720 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1589 T720 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1590 T720 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354432672485/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/
[junit4:junit4]   2> 1590 T720 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2f95e
[junit4:junit4]   2> 1590 T720 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1591 T720 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3b947; maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
[junit4:junit4]   2> 1591 T720 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data forceNew:false
[junit4:junit4]   2> 1592 T720 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data
[junit4:junit4]   2> 1592 T720 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index/
[junit4:junit4]   2> 1592 T720 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1593 T720 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index forceNew:false
[junit4:junit4]   2> 1597 T720 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e28c9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1597 T720 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1598 T720 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index
[junit4:junit4]   2> 1598 T720 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1600 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1600 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1601 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1601 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1602 T720 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1602 T720 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1603 T720 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1604 T720 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1605 T720 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1606 T720 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1607 T720 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1607 T720 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1608 T720 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1609 T720 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1609 T720 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1610 T720 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1611 T720 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1612 T720 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1613 T720 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1614 T720 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1615 T720 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1616 T720 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1617 T720 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1617 T720 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1618 T720 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1621 T720 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1631 T720 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1632 T720 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1634 T720 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data
[junit4:junit4]   2> 1635 T720 oass.SolrIndexSearcher.<init> Opening Searcher@1eb3560 main
[junit4:junit4]   2> 1635 T720 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1636 T720 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1636 T720 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1639 T720 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1665 T721 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1eb3560 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1677 T720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1678 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x56 zxid:0x28 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1981 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1982 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36976_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36976/solr"}
[junit4:junit4]   2> 1982 T718 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 1982 T718 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1983 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x5e zxid:0x2b txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1987 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2180 T720 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2180 T720 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:36976/solr shardId:shard1
[junit4:junit4]   2> 2181 T720 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2186 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:delete cxid:0x78 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2186 T720 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2186 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x79 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2188 T720 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2188 T720 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2188 T720 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36976/solr/collection1/
[junit4:junit4]   2> 2189 T720 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2189 T720 oasc.SyncStrategy.syncToMe http://127.0.0.1:36976/solr/collection1/ has no replicas
[junit4:junit4]   2> 2189 T720 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36976/solr/collection1/
[junit4:junit4]   2> 2189 T720 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2194 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40002 type:create cxid:0x83 zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2491 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2701 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2746 T720 oasc.ZkController.register We are http://127.0.0.1:36976/solr/collection1/ and leader is http://127.0.0.1:36976/solr/collection1/
[junit4:junit4]   2> 2747 T720 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36976/solr
[junit4:junit4]   2> 2748 T720 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2748 T720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2750 T720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2752 T697 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2753 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2754 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2759 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 2763 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1329b40
[junit4:junit4]   2> 2770 T722 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2764 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2771 T722 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 2771 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37023
[junit4:junit4]   2> 2771 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37023
[junit4:junit4]   2> 2772 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40003 with negotiated timeout 10000 for client /127.0.0.1:37023
[junit4:junit4]   2> 2772 T722 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40003, negotiated timeout = 10000
[junit4:junit4]   2> 2772 T723 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1329b40 name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2772 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2773 T697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2776 T697 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 2830 T697 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 2832 T697 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:40178
[junit4:junit4]   2> 2832 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2833 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996
[junit4:junit4]   2> 2833 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/'
[junit4:junit4]   2> 2854 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2855 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2856 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996
[junit4:junit4]   2> 2856 T697 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/solr.xml
[junit4:junit4]   2> 2856 T697 oasc.CoreContainer.<init> New CoreContainer 11405420
[junit4:junit4]   2> 2857 T697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/'
[junit4:junit4]   2> 2857 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/'
[junit4:junit4]   2> 2879 T697 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2902 T697 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50485/solr
[junit4:junit4]   2> 2903 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1679918
[junit4:junit4]   2> 2904 T733 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2904 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2905 T733 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 2905 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37024
[junit4:junit4]   2> 2906 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37024
[junit4:junit4]   2> 2907 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40004 with negotiated timeout 8000 for client /127.0.0.1:37024
[junit4:junit4]   2> 2907 T733 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40004, negotiated timeout = 8000
[junit4:junit4]   2> 2907 T734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1679918 name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2907 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2908 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40004 type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2909 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40004 type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2910 T697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40178_solr
[junit4:junit4]   2> 2910 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40004 type:delete cxid:0x4 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40178_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40178_solr
[junit4:junit4]   2> 2912 T697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40178_solr
[junit4:junit4]   2> 2915 T717 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2915 T723 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2915 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2916 T697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2916 T697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2917 T697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2917 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2917 T697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2918 T697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2918 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2919 T697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2919 T697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2919 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2924 T697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2930 T735 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/collection1
[junit4:junit4]   2> 2930 T735 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2930 T735 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2931 T735 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2931 T735 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/collection1/'
[junit4:junit4]   2> 2932 T735 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/collection1/lib/README' to classloader
[junit4:junit4]   2> 2932 T735 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2985 T735 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3064 T735 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3074 T735 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3078 T735 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3207 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3208 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36976_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36976/solr"}
[junit4:junit4]   2> 3211 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3211 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3211 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3853 T735 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3859 T735 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3861 T735 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3881 T735 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3886 T735 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3891 T735 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3892 T735 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3893 T735 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354432674996/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/
[junit4:junit4]   2> 3893 T735 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2f95e
[junit4:junit4]   2> 3894 T735 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 3895 T735 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b57632; maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
[junit4:junit4]   2> 3895 T735 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1 forceNew:false
[junit4:junit4]   2> 3896 T735 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1
[junit4:junit4]   2> 3896 T735 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/index/
[junit4:junit4]   2> 3897 T735 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3897 T735 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/index forceNew:false
[junit4:junit4]   2> 3902 T735 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e7ab1c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3902 T735 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3903 T735 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/index
[junit4:junit4]   2> 3903 T735 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3905 T735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3906 T735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3906 T735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3906 T735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3907 T735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3908 T735 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3908 T735 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3909 T735 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3910 T735 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3911 T735 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3913 T735 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3913 T735 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3914 T735 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3914 T735 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3915 T735 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3926 T735 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3928 T735 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3929 T735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3930 T735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3931 T735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3932 T735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3933 T735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3935 T735 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3936 T735 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3937 T735 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3941 T735 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3942 T735 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3944 T735 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3945 T735 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1
[junit4:junit4]   2> 3946 T735 oass.SolrIndexSearcher.<init> Opening Searcher@999a9e main
[junit4:junit4]   2> 3947 T735 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3947 T735 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3948 T735 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3951 T735 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3987 T736 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@999a9e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3991 T735 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4230 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4231 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40178_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40178/solr"}
[junit4:junit4]   2> 4231 T718 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 4231 T718 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4236 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4236 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4236 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4492 T735 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4493 T735 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:40178/solr shardId:shard1
[junit4:junit4]   2> 4494 T735 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4514 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40004 type:delete cxid:0x45 zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4515 T735 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4516 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40004 type:create cxid:0x46 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4517 T735 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4517 T735 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4517 T735 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40178/solr/collection1/
[junit4:junit4]   2> 4518 T735 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4518 T735 oasc.SyncStrategy.syncToMe http://127.0.0.1:40178/solr/collection1/ has no replicas
[junit4:junit4]   2> 4518 T735 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40178/solr/collection1/
[junit4:junit4]   2> 4518 T735 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4521 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40004 type:create cxid:0x50 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4744 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4782 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4782 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4782 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 4813 T735 oasc.ZkController.register We are http://127.0.0.1:40178/solr/collection1/ and leader is http://127.0.0.1:40178/solr/collection1/
[junit4:junit4]   2> 4813 T735 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40178/solr
[junit4:junit4]   2> 4814 T735 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4814 T735 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4817 T735 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4818 T697 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4818 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4819 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4888 T697 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 4891 T697 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:59573
[junit4:junit4]   2> 4892 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4893 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042
[junit4:junit4]   2> 4893 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/'
[junit4:junit4]   2> 4920 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4920 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4921 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042
[junit4:junit4]   2> 4921 T697 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/solr.xml
[junit4:junit4]   2> 4921 T697 oasc.CoreContainer.<init> New CoreContainer 28816372
[junit4:junit4]   2> 4922 T697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/'
[junit4:junit4]   2> 4922 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/'
[junit4:junit4]   2> 4944 T697 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4960 T697 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50485/solr
[junit4:junit4]   2> 4960 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@6764dc
[junit4:junit4]   2> 4962 T746 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4961 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4962 T746 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 4962 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37026
[junit4:junit4]   2> 4963 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37026
[junit4:junit4]   2> 4968 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40005 with negotiated timeout 8000 for client /127.0.0.1:37026
[junit4:junit4]   2> 4968 T746 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40005, negotiated timeout = 8000
[junit4:junit4]   2> 4968 T747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6764dc name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4969 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4970 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40005 type:create cxid:0x1 zxid:0x68 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4984 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40005 type:create cxid:0x2 zxid:0x69 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5003 T697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59573_solr
[junit4:junit4]   2> 5004 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40005 type:delete cxid:0x4 zxid:0x6a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59573_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59573_solr
[junit4:junit4]   2> 5013 T697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59573_solr
[junit4:junit4]   2> 5015 T723 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5015 T717 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5016 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5015 T734 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5016 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5016 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5016 T697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5017 T697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5017 T697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5018 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5018 T697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5019 T697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5019 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5019 T697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5020 T697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5020 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5043 T697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5055 T748 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/collection1
[junit4:junit4]   2> 5055 T748 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5056 T748 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5056 T748 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5057 T748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/collection1/'
[junit4:junit4]   2> 5057 T748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/collection1/lib/README' to classloader
[junit4:junit4]   2> 5058 T748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5110 T748 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 5202 T748 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5202 T748 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5207 T748 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5296 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5297 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40178_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40178/solr"}
[junit4:junit4]   2> 5327 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5327 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5327 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5327 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5966 T748 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5979 T748 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5982 T748 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5991 T748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5994 T748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5997 T748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6005 T748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6006 T748 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354432677042/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/
[junit4:junit4]   2> 6007 T748 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2f95e
[junit4:junit4]   2> 6007 T748 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 6008 T748 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1710d82; maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
[junit4:junit4]   2> 6008 T748 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2 forceNew:false
[junit4:junit4]   2> 6008 T748 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2
[junit4:junit4]   2> 6009 T748 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/index/
[junit4:junit4]   2> 6009 T748 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6009 T748 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/index forceNew:false
[junit4:junit4]   2> 6021 T748 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@56b439; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6022 T748 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6022 T748 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/index
[junit4:junit4]   2> 6022 T748 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 6024 T748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6024 T748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 6024 T748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6025 T748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 6025 T748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6025 T748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6026 T748 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6026 T748 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6027 T748 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6028 T748 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 6029 T748 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 6029 T748 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6030 T748 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 6030 T748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 6030 T748 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 6031 T748 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6032 T748 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6032 T748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6033 T748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6034 T748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6035 T748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6035 T748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6036 T748 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 6037 T748 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 6037 T748 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 6040 T748 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6050 T748 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 6051 T748 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 6054 T748 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2
[junit4:junit4]   2> 6055 T748 oass.SolrIndexSearcher.<init> Opening Searcher@1b29545 main
[junit4:junit4]   2> 6056 T748 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6056 T748 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6056 T748 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 6073 T748 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 6133 T749 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b29545 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6149 T748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6346 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6346 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59573_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59573/solr"}
[junit4:junit4]   2> 6346 T718 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 6347 T718 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6371 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6371 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6371 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6371 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6652 T748 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6653 T748 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:59573/solr shardId:shard2
[junit4:junit4]   2> 6654 T748 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 6674 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40005 type:delete cxid:0x44 zxid:0x79 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 6674 T748 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6675 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40005 type:create cxid:0x45 zxid:0x7a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6685 T748 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6685 T748 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6686 T748 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59573/solr/collection1/
[junit4:junit4]   2> 6686 T748 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6686 T748 oasc.SyncStrategy.syncToMe http://127.0.0.1:59573/solr/collection1/ has no replicas
[junit4:junit4]   2> 6686 T748 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59573/solr/collection1/
[junit4:junit4]   2> 6686 T748 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 6693 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40005 type:create cxid:0x4e zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6884 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6941 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6941 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6941 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6941 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6945 T748 oasc.ZkController.register We are http://127.0.0.1:59573/solr/collection1/ and leader is http://127.0.0.1:59573/solr/collection1/
[junit4:junit4]   2> 6945 T748 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59573/solr
[junit4:junit4]   2> 6945 T748 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6945 T748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6973 T748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6983 T697 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6983 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6984 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7079 T697 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 7081 T697 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:32792
[junit4:junit4]   2> 7082 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7083 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216
[junit4:junit4]   2> 7083 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/'
[junit4:junit4]   2> 7108 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7109 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7109 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216
[junit4:junit4]   2> 7110 T697 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/solr.xml
[junit4:junit4]   2> 7111 T697 oasc.CoreContainer.<init> New CoreContainer 32486596
[junit4:junit4]   2> 7111 T697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/'
[junit4:junit4]   2> 7112 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/'
[junit4:junit4]   2> 7159 T697 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7181 T697 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50485/solr
[junit4:junit4]   2> 7182 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f7cfcf
[junit4:junit4]   2> 7183 T759 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7182 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7183 T759 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 7183 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37028
[junit4:junit4]   2> 7184 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37028
[junit4:junit4]   2> 7202 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40006 with negotiated timeout 8000 for client /127.0.0.1:37028
[junit4:junit4]   2> 7202 T759 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40006, negotiated timeout = 8000
[junit4:junit4]   2> 7203 T760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7cfcf name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7203 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7204 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40006 type:create cxid:0x1 zxid:0x88 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7223 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40006 type:create cxid:0x2 zxid:0x89 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7233 T697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32792_solr
[junit4:junit4]   2> 7234 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40006 type:delete cxid:0x4 zxid:0x8a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32792_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32792_solr
[junit4:junit4]   2> 7235 T697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32792_solr
[junit4:junit4]   2> 7237 T747 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7237 T723 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7237 T734 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7237 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7237 T717 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 7237 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7238 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7238 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7238 T697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 7239 T697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7240 T697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 7240 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7240 T697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7241 T697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7241 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7242 T697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7243 T697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7243 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 7253 T697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7262 T761 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/collection1
[junit4:junit4]   2> 7262 T761 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7263 T761 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7263 T761 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7265 T761 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/collection1/'
[junit4:junit4]   2> 7266 T761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/collection1/lib/README' to classloader
[junit4:junit4]   2> 7267 T761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7338 T761 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7422 T761 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7429 T761 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7434 T761 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7484 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7492 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59573_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59573/solr"}
[junit4:junit4]   2> 7521 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7521 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7521 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7521 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 7521 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 8180 T761 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8187 T761 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8189 T761 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8207 T761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8210 T761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8213 T761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8214 T761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8215 T761 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354432679216/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/
[junit4:junit4]   2> 8215 T761 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2f95e
[junit4:junit4]   2> 8216 T761 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8216 T761 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@526b8; maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
[junit4:junit4]   2> 8217 T761 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3 forceNew:false
[junit4:junit4]   2> 8217 T761 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3
[junit4:junit4]   2> 8218 T761 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index/
[junit4:junit4]   2> 8218 T761 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8218 T761 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index forceNew:false
[junit4:junit4]   2> 8291 T761 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@915984; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8292 T761 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8292 T761 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index
[junit4:junit4]   2> 8292 T761 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8294 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8294 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8294 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8295 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8295 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8295 T761 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8295 T761 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8296 T761 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8297 T761 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8298 T761 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8299 T761 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8299 T761 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8300 T761 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8300 T761 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8307 T761 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8308 T761 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8308 T761 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8309 T761 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8310 T761 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8310 T761 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8311 T761 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8312 T761 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8312 T761 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8313 T761 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8314 T761 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8316 T761 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8318 T761 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8319 T761 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8321 T761 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3
[junit4:junit4]   2> 8322 T761 oass.SolrIndexSearcher.<init> Opening Searcher@4588b7 main
[junit4:junit4]   2> 8322 T761 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8322 T761 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8323 T761 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8343 T761 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8544 T762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4588b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8548 T761 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9038 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9038 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32792_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32792/solr"}
[junit4:junit4]   2> 9038 T718 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 9039 T718 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9052 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9051 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9060 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9052 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9052 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9550 T761 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9550 T761 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:32792/solr shardId:shard1
[junit4:junit4]   2> 9554 T761 oasc.ZkController.register We are http://127.0.0.1:32792/solr/collection1/ and leader is http://127.0.0.1:40178/solr/collection1/
[junit4:junit4]   2> 9555 T761 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32792/solr
[junit4:junit4]   2> 9555 T761 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 9555 T761 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C35 name=collection1 org.apache.solr.core.SolrCore@1ac81c9 url=http://127.0.0.1:32792/solr/collection1 node=127.0.0.1:32792_solr
[junit4:junit4]   2> 9559 T763 C35 P32792 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 9559 T761 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9560 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9560 T763 C35 P32792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9561 T697 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 9561 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9562 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9562 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40178/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 9564 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9564 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32792_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32792/solr"}
[junit4:junit4]   2> 9567 T763 C35 P32792 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 9572 T763 C35 P32792 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:32792/solr START replicas=[http://127.0.0.1:40178/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 9573 T763 C35 P32792 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 9573 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 9574 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 9574 T763 C35 P32792 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9583 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9583 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9583 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9583 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9586 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> ASYNC  NEW_CORE C36 name=collection1 org.apache.solr.core.SolrCore@1dc6ff8 url=http://127.0.0.1:40178/solr/collection1 node=127.0.0.1:40178_solr
[junit4:junit4]   2> 9586 T732 C36 P40178 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 9643 T697 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 9645 T697 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:57908
[junit4:junit4]   2> 9646 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9646 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786
[junit4:junit4]   2> 9647 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/'
[junit4:junit4]   2> 9659 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9660 T697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9660 T697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786
[junit4:junit4]   2> 9660 T697 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/solr.xml
[junit4:junit4]   2> 9661 T697 oasc.CoreContainer.<init> New CoreContainer 2199121
[junit4:junit4]   2> 9661 T697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/'
[junit4:junit4]   2> 9662 T697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/'
[junit4:junit4]   2> 9684 T697 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9707 T697 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50485/solr
[junit4:junit4]   2> 9708 T697 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50485/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e79455
[junit4:junit4]   2> 9709 T774 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:50485. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9709 T697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9709 T774 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:50485, initiating session
[junit4:junit4]   2> 9709 T699 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37031
[junit4:junit4]   2> 9710 T699 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37031
[junit4:junit4]   2> 9722 T701 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b5a7a71e40007 with negotiated timeout 8000 for client /127.0.0.1:37031
[junit4:junit4]   2> 9722 T774 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:50485, sessionid = 0x13b5a7a71e40007, negotiated timeout = 8000
[junit4:junit4]   2> 9723 T775 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e79455 name:ZooKeeperConnection Watcher:127.0.0.1:50485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9723 T697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9724 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40007 type:create cxid:0x1 zxid:0x9d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9743 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40007 type:create cxid:0x2 zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9763 T697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57908_solr
[junit4:junit4]   2> 9763 T702 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b5a7a71e40007 type:delete cxid:0x4 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57908_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57908_solr
[junit4:junit4]   2> 9764 T697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57908_solr
[junit4:junit4]   2> 9766 T747 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9766 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (4)
[junit4:junit4]   2> 9766 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9767 T717 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9767 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9767 T697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 9768 T697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9767 T723 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9767 T734 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9768 T697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 9768 T760 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 9769 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9769 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 9769 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9770 T697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9770 T697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9771 T697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9771 T697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9771 T697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9772 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 9778 T697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9789 T776 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/collection1
[junit4:junit4]   2> 9790 T776 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9790 T776 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9790 T776 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9791 T776 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/collection1/'
[junit4:junit4]   2> 9792 T776 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/collection1/lib/README' to classloader
[junit4:junit4]   2> 9792 T776 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9844 T776 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 9931 T776 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9932 T776 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9941 T776 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10743 T776 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10749 T776 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10759 T776 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10769 T776 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10772 T776 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10775 T776 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10776 T776 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10777 T776 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354432681786/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/
[junit4:junit4]   2> 10777 T776 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2f95e
[junit4:junit4]   2> 10777 T776 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10778 T776 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b8e70; maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
[junit4:junit4]   2> 10778 T776 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4 forceNew:false
[junit4:junit4]   2> 10778 T776 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4
[junit4:junit4]   2> 10779 T776 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index/
[junit4:junit4]   2> 10779 T776 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10779 T776 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index forceNew:false
[junit4:junit4]   2> 10812 T776 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a48ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10813 T776 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10814 T776 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index
[junit4:junit4]   2> 10815 T776 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10817 T776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10818 T776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10819 T776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10819 T776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10820 T776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10821 T776 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10828 T776 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10829 T776 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10829 T776 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10830 T776 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10831 T776 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10831 T776 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10832 T776 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10832 T776 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10832 T776 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10833 T776 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10834 T776 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10835 T776 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10835 T776 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10837 T776 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10838 T776 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10838 T776 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10839 T776 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10840 T776 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10840 T776 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10843 T776 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10845 T776 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10846 T776 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 10848 T776 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4
[junit4:junit4]   2> 10848 T776 oass.SolrIndexSearcher.<init> Opening Searcher@1761493 main
[junit4:junit4]   2> 10849 T776 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10849 T776 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10860 T776 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10883 T776 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 11244 T777 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1761493 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11262 T776 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2>  C35_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:32792_solr, base_url=http://127.0.0.1:32792/solr}
[junit4:junit4]   2> 11589 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 11590 T763 C35 P32792 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 11590 T763 C35 P32792 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40178/solr/collection1/. core=collection1
[junit4:junit4]   2> 11590 T763 C35 P32792 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11595 T729 C36 P40178 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11596 T729 C36 P40178 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1
[junit4:junit4]   2> 11598 T729 C36 P40178 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e7ab1c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11599 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11601 T729 C36 P40178 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11603 T729 C36 P40178 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1
[junit4:junit4]   2> 11603 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57908_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57908/solr"}
[junit4:junit4]   2> 11603 T718 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 11603 T729 C36 P40178 oass.SolrIndexSearcher.<init> Opening Searcher@455f28 realtime
[junit4:junit4]   2> 11604 T718 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 11604 T729 C36 P40178 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11604 T729 C36 P40178 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 10
[junit4:junit4]   2> 11606 T763 C35 P32792 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11607 T763 C35 P32792 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 11607 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11607 T775 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11607 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11607 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11607 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11607 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 11614 T763 C35 P32792 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 11617 T731 C36 P40178 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 11618 T731 C36 P40178 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 11619 T763 C35 P32792 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3
[junit4:junit4]   2> 11620 T763 C35 P32792 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@915984; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11621 T763 C35 P32792 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11622 T763 C35 P32792 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 11631 T763 C35 P32792 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@915984; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@915984; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 11632 T763 C35 P32792 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 11632 T763 C35 P32792 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3
[junit4:junit4]   2> 11633 T763 C35 P32792 oass.SolrIndexSearcher.<init> Opening Searcher@ca1081 main
[junit4:junit4]   2> 11633 T763 C35 P32792 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 11648 T762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ca1081 main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 11648 T762 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3/index
[junit4:junit4]   2> 11648 T763 C35 P32792 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 11648 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 11649 T763 C35 P32792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11651 T763 C35 P32792 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 11763 T776 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11764 T776 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:57908/solr shardId:shard2
[junit4:junit4]   2> 11773 T776 oasc.ZkController.register We are http://127.0.0.1:57908/solr/collection1/ and leader is http://127.0.0.1:59573/solr/collection1/
[junit4:junit4]   2> 11773 T776 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57908/solr
[junit4:junit4]   2> 11774 T776 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11774 T776 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C37 name=collection1 org.apache.solr.core.SolrCore@1b7c4fe url=http://127.0.0.1:57908/solr/collection1 node=127.0.0.1:57908_solr
[junit4:junit4]   2> 11774 T778 C37 P57908 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11775 T776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11776 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11776 T778 C37 P57908 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11777 T697 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 11778 T697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11778 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59573/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 11779 T778 C37 P57908 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57908/solr START replicas=[http://127.0.0.1:59573/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 11778 T697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11779 T778 C37 P57908 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 11780 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 11780 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 11780 T778 C37 P57908 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11783 T697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11785 T697 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):540
[junit4:junit4]   2> 11786 T697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C38 name=collection1 org.apache.solr.core.SolrCore@1a66ef9 url=http://127.0.0.1:59573/solr/collection1 node=127.0.0.1:59573_solr
[junit4:junit4]   2> 11787 T743 C38 P59573 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 12112 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12113 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:32792_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:32792/solr"}
[junit4:junit4]   2> 12116 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57908_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57908/solr"}
[junit4:junit4]   2> 12118 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12119 T775 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12119 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12118 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12118 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12119 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 12799 T697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13800 T697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C37_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:57908_solr, base_url=http://127.0.0.1:57908/solr}
[junit4:junit4]   2> 14784 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 14785 T778 C37 P57908 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 14785 T778 C37 P57908 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59573/solr/collection1/. core=collection1
[junit4:junit4]   2> 14785 T778 C37 P57908 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14788 T742 C38 P59573 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 14789 T742 C38 P59573 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2
[junit4:junit4]   2> 14791 T742 C38 P59573 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@56b439; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14791 T742 C38 P59573 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14792 T742 C38 P59573 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2
[junit4:junit4]   2> 14792 T742 C38 P59573 oass.SolrIndexSearcher.<init> Opening Searcher@16d2104 realtime
[junit4:junit4]   2> 14792 T742 C38 P59573 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14793 T742 C38 P59573 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 5
[junit4:junit4]   2> 14794 T778 C37 P57908 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 14794 T778 C37 P57908 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 14796 T744 C38 P59573 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 14796 T744 C38 P59573 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 14797 T778 C37 P57908 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4
[junit4:junit4]   2> 14798 T778 C37 P57908 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a48ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14798 T778 C37 P57908 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14799 T778 C37 P57908 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 14802 T697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14841 T778 C37 P57908 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a48ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12a48ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 14842 T778 C37 P57908 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 14842 T778 C37 P57908 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4
[junit4:junit4]   2> 14843 T778 C37 P57908 oass.SolrIndexSearcher.<init> Opening Searcher@f85872 main
[junit4:junit4]   2> 14843 T778 C37 P57908 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14851 T777 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f85872 main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 14852 T777 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4/index
[junit4:junit4]   2> 14852 T778 C37 P57908 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 14852 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 14852 T778 C37 P57908 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14854 T778 C37 P57908 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 15132 T718 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15133 T718 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57908_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57908/solr"}
[junit4:junit4]   2> 15145 T723 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 15145 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 15145 T734 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 15145 T775 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 15145 T760 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 15145 T717 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (5)
[junit4:junit4]   2> 15804 T697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C39 name=collection1 org.apache.solr.core.SolrCore@194fc00 url=http://127.0.0.1:36976/solr/collection1 node=127.0.0.1:36976_solr
[junit4:junit4]   2> 15813 T713 C39 P36976 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data
[junit4:junit4]   2> 15815 T713 C39 P36976 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e28c9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15816 T713 C39 P36976 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15817 T713 C39 P36976 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data
[junit4:junit4]   2> 15818 T713 C39 P36976 oass.SolrIndexSearcher.<init> Opening Searcher@1b31588 realtime
[junit4:junit4]   2> 15818 T713 C39 P36976 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1420225610285842432)} 0 7
[junit4:junit4]   2> 15822 T730 C36 P40178 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty1
[junit4:junit4]   2> 15824 T742 C38 P59573 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty2
[junit4:junit4]   2>  C35_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:32792_solr, base_url=http://127.0.0.1:32792/solr}
[junit4:junit4]   2> 15843 T757 C35 P32792 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty3
[junit4:junit4]   2> 15844 T757 C35 P32792 oass.SolrIndexSearcher.<init> Opening Searcher@29dbfd realtime
[junit4:junit4]   2> 15844 T757 C35 P32792 REQ /update {update.distrib=FROMLEADER&_version_=-1420225610295279616&update.from=http://127.0.0.1:40178/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2>  C37_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57908_solr, base_url=http://127.0.0.1:57908/solr}
[junit4:junit4]   2> 15845 T772 C37 P57908 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/jetty4
[junit4:junit4]   2> 15846 T772 C37 P57908 oass.SolrIndexSearcher.<init> Opening Searcher@1414817 realtime
[junit4:junit4]   2> 15847 T772 C37 P57908 REQ /update {update.distrib=FROMLEADER&_version_=-1420225610298425344&update.from=http://127.0.0.1:59573/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15847 T742 C38 P59573 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=23 
[junit4:junit4]   2> 15848 T730 C36 P40178 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1420225610295279616)} 0 27
[junit4:junit4]   2> 15853 T712 C39 P36976 /update {wt=javabin&version=2} {add=[1 (1420225610326736896)]} 0 3
[junit4:junit4]   2> 15876 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15877 T732 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=20 
[junit4:junit4]   2> 15878 T745 C38 P59573 /update {wt=javabin&version=2} {add=[1]} 0 24
[junit4:junit4]   2> 15882 T715 C39 P36976 /update {wt=javabin&version=2} {add=[2 (1420225610358194176)]} 0 1
[junit4:junit4]   2> 15890 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15891 T743 C38 P59573 /update {wt=javabin&version=2} {add=[2 (1420225610361339904)]} 0 7
[junit4:junit4]   2> 15895 T714 C39 P36976 /update {wt=javabin&version=2} {add=[3 (1420225610370777088)]} 0 2
[junit4:junit4]   2> 15902 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15902 T744 C38 P59573 /update {wt=javabin&version=2} {add=[3 (1420225610376019968)]} 0 5
[junit4:junit4]   2> 15906 T713 C39 P36976 /update {wt=javabin&version=2} {add=[4 (1420225610383360000)]} 0 1
[junit4:junit4]   2> 15914 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15915 T731 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 15915 T742 C38 P59573 /update {wt=javabin&version=2} {add=[4]} 0 7
[junit4:junit4]   2> 15919 T712 C39 P36976 /update {wt=javabin&version=2} {add=[5 (1420225610396991488)]} 0 2
[junit4:junit4]   2> 15927 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15928 T745 C38 P59573 /update {wt=javabin&version=2} {add=[5 (1420225610401185792)]} 0 7
[junit4:junit4]   2> 15931 T715 C39 P36976 /update {wt=javabin&version=2} {add=[6 (1420225610409574400)]} 0 1
[junit4:junit4]   2> 15947 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=9 
[junit4:junit4]   2> 15948 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=13 
[junit4:junit4]   2> 15948 T730 C36 P40178 /update {wt=javabin&version=2} {add=[6]} 0 15
[junit4:junit4]   2> 15952 T714 C39 P36976 /update {wt=javabin&version=2} {add=[7 (1420225610431594496)]} 0 1
[junit4:junit4]   2> 15960 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15961 T744 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 15961 T729 C36 P40178 /update {wt=javabin&version=2} {add=[7]} 0 7
[junit4:junit4]   2> 15965 T713 C39 P36976 /update {wt=javabin&version=2} {add=[8 (1420225610445225984)]} 0 1
[junit4:junit4]   2> 15971 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15972 T732 C36 P40178 /update {wt=javabin&version=2} {add=[8 (1420225610448371712)]} 0 5
[junit4:junit4]   2> 15976 T712 C39 P36976 /update {wt=javabin&version=2} {add=[9 (1420225610456760320)]} 0 2
[junit4:junit4]   2> 15982 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15983 T742 C38 P59573 /update {wt=javabin&version=2} {add=[9 (1420225610459906048)]} 0 5
[junit4:junit4]   2> 15994 T715 C39 P36976 /update {wt=javabin&version=2} {add=[10 (1420225610467246080)]} 0 9
[junit4:junit4]   2> 16002 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16003 T731 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16003 T745 C38 P59573 /update {wt=javabin&version=2} {add=[10]} 0 7
[junit4:junit4]   2> 16008 T713 C39 P36976 /update {wt=javabin&version=2} {add=[11 (1420225610489266176)]} 0 2
[junit4:junit4]   2> 16016 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16017 T730 C36 P40178 /update {wt=javabin&version=2} {add=[11 (1420225610494509056)]} 0 6
[junit4:junit4]   2> 16020 T712 C39 P36976 /update {wt=javabin&version=2} {add=[12 (1420225610502897664)]} 0 1
[junit4:junit4]   2> 16029 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16030 T732 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16030 T744 C38 P59573 /update {wt=javabin&version=2} {add=[12]} 0 7
[junit4:junit4]   2> 16034 T714 C39 P36976 /update {wt=javabin&version=2} {add=[13 (1420225610517577728)]} 0 1
[junit4:junit4]   2> 16058 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16059 T731 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16059 T742 C38 P59573 /update {wt=javabin&version=2} {add=[13]} 0 7
[junit4:junit4]   2> 16063 T715 C39 P36976 /update {wt=javabin&version=2} {add=[14 (1420225610547986432)]} 0 1
[junit4:junit4]   2> 16070 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16070 T730 C36 P40178 /update {wt=javabin&version=2} {add=[14 (1420225610552180736)]} 0 4
[junit4:junit4]   2> 16075 T712 C39 P36976 /update {wt=javabin&version=2} {add=[15 (1420225610560569344)]} 0 1
[junit4:junit4]   2> 16081 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16082 T729 C36 P40178 /update {wt=javabin&version=2} {add=[15 (1420225610563715072)]} 0 5
[junit4:junit4]   2> 16085 T714 C39 P36976 /update {wt=javabin&version=2} {add=[16 (1420225610571055104)]} 0 1
[junit4:junit4]   2> 16104 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 16105 T732 C36 P40178 /update {wt=javabin&version=2} {add=[16 (1420225610575249408)]} 0 17
[junit4:junit4]   2> 16111 T715 C39 P36976 /update {wt=javabin&version=2} {add=[17 (1420225610596220928)]} 0 4
[junit4:junit4]   2> 16130 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=10 
[junit4:junit4]   2> 16131 T745 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=16 
[junit4:junit4]   2> 16131 T731 C36 P40178 /update {wt=javabin&version=2} {add=[17]} 0 18
[junit4:junit4]   2> 16135 T713 C39 P36976 /update {wt=javabin&version=2} {add=[100 (1420225610623483904)]} 0 1
[junit4:junit4]   2> 16142 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16142 T730 C36 P40178 /update {wt=javabin&version=2} {add=[100 (1420225610626629632)]} 0 5
[junit4:junit4]   2> 16145 T712 C39 P36976 /update {wt=javabin&version=2} {add=[101 (1420225610635018240)]} 0 0
[junit4:junit4]   2> 16152 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16153 T729 C36 P40178 /update {wt=javabin&version=2} {add=[101 (1420225610638163968)]} 0 5
[junit4:junit4]   2> 16163 T714 C39 P36976 /update {wt=javabin&version=2} {add=[102 (1420225610646552576)]} 0 7
[junit4:junit4]   2> 16171 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16171 T732 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16172 T744 C38 P59573 /update {wt=javabin&version=2} {add=[102]} 0 6
[junit4:junit4]   2> 16175 T715 C39 P36976 /update {wt=javabin&version=2} {add=[103 (1420225610665426944)]} 0 1
[junit4:junit4]   2> 16183 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16184 T742 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16184 T731 C36 P40178 /update {wt=javabin&version=2} {add=[103]} 0 6
[junit4:junit4]   2> 16187 T713 C39 P36976 /update {wt=javabin&version=2} {add=[104 (1420225610678009856)]} 0 1
[junit4:junit4]   2> 16194 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16194 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16203 T730 C36 P40178 /update {wt=javabin&version=2} {add=[104]} 0 14
[junit4:junit4]   2> 16207 T712 C39 P36976 /update {wt=javabin&version=2} {add=[105 (1420225610698981376)]} 0 1
[junit4:junit4]   2> 16228 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 16229 T745 C38 P59573 /update {wt=javabin&version=2} {add=[105 (1420225610702127104)]} 0 20
[junit4:junit4]   2> 16232 T715 C39 P36976 /update {wt=javabin&version=2} {add=[106 (1420225610725195776)]} 0 1
[junit4:junit4]   2> 16284 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16285 T744 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 16285 T729 C36 P40178 /update {wt=javabin&version=2} {add=[106]} 0 51
[junit4:junit4]   2> 16288 T713 C39 P36976 /update {wt=javabin&version=2} {add=[107 (1420225610783916032)]} 0 1
[junit4:junit4]   2> 16296 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16297 T732 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16298 T742 C38 P59573 /update {wt=javabin&version=2} {add=[107]} 0 7
[junit4:junit4]   2> 16302 T712 C39 P36976 /update {wt=javabin&version=2} {add=[108 (1420225610798596096)]} 0 1
[junit4:junit4]   2> 16308 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16308 T730 C36 P40178 /update {wt=javabin&version=2} {add=[108 (1420225610802790400)]} 0 4
[junit4:junit4]   2> 16311 T714 C39 P36976 /update {wt=javabin&version=2} {add=[109 (1420225610809081856)]} 0 1
[junit4:junit4]   2> 16317 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16333 T729 C36 P40178 /update {wt=javabin&version=2} {add=[109 (1420225610812227584)]} 0 20
[junit4:junit4]   2> 16337 T715 C39 P36976 /update {wt=javabin&version=2} {add=[110 (1420225610835296256)]} 0 1
[junit4:junit4]   2> 16342 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16343 T731 C36 P40178 /update {wt=javabin&version=2} {add=[110 (1420225610838441984)]} 0 4
[junit4:junit4]   2> 16346 T713 C39 P36976 /update {wt=javabin&version=2} {add=[111 (1420225610844733440)]} 0 1
[junit4:junit4]   2> 16353 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16354 T732 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16355 T743 C38 P59573 /update {wt=javabin&version=2} {add=[111]} 0 7
[junit4:junit4]   2> 16365 T712 C39 P36976 /update {wt=javabin&version=2} {add=[112 (1420225610857316352)]} 0 8
[junit4:junit4]   2> 16372 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16373 T745 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16374 T730 C36 P40178 /update {wt=javabin&version=2} {add=[112]} 0 6
[junit4:junit4]   2> 16377 T714 C39 P36976 /update {wt=javabin&version=2} {add=[113 (1420225610877239296)]} 0 1
[junit4:junit4]   2> 16385 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16385 T729 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16386 T744 C38 P59573 /update {wt=javabin&version=2} {add=[113]} 0 6
[junit4:junit4]   2> 16389 T715 C39 P36976 /update {wt=javabin&version=2} {add=[114 (1420225610889822208)]} 0 1
[junit4:junit4]   2> 16410 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=12 
[junit4:junit4]   2> 16411 T731 C36 P40178 /update {wt=javabin&version=2} {add=[114 (1420225610892967936)]} 0 20
[junit4:junit4]   2> 16414 T713 C39 P36976 /update {wt=javabin&version=2} {add=[115 (1420225610917085184)]} 0 1
[junit4:junit4]   2> 16421 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16422 T742 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16423 T732 C36 P40178 /update {wt=javabin&version=2} {add=[115]} 0 7
[junit4:junit4]   2> 16425 T712 C39 P36976 /update {wt=javabin&version=2} {add=[116 (1420225610928619520)]} 0 0
[junit4:junit4]   2> 16432 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16433 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16433 T729 C36 P40178 /update {wt=javabin&version=2} {add=[116]} 0 6
[junit4:junit4]   2> 16436 T714 C39 P36976 /update {wt=javabin&version=2} {add=[117 (1420225610939105280)]} 0 1
[junit4:junit4]   2> 16442 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16442 T745 C38 P59573 /update {wt=javabin&version=2} {add=[117 (1420225610943299584)]} 0 4
[junit4:junit4]   2> 16445 T715 C39 P36976 /update {wt=javabin&version=2} {add=[118 (1420225610949591040)]} 0 1
[junit4:junit4]   2> 16451 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16451 T731 C36 P40178 /update {wt=javabin&version=2} {add=[118 (1420225610951688192)]} 0 4
[junit4:junit4]   2> 16454 T713 C39 P36976 /update {wt=javabin&version=2} {add=[119 (1420225610959028224)]} 0 0
[junit4:junit4]   2> 16461 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16462 T742 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16462 T732 C36 P40178 /update {wt=javabin&version=2} {add=[119]} 0 5
[junit4:junit4]   2> 16465 T712 C39 P36976 /update {wt=javabin&version=2} {add=[120 (1420225610969513984)]} 0 1
[junit4:junit4]   2> 16473 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16473 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16474 T730 C36 P40178 /update {wt=javabin&version=2} {add=[120]} 0 7
[junit4:junit4]   2> 16477 T714 C39 P36976 /update {wt=javabin&version=2} {add=[121 (1420225610982096896)]} 0 1
[junit4:junit4]   2> 16481 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16482 T744 C38 P59573 /update {wt=javabin&version=2} {add=[121 (1420225610985242624)]} 0 4
[junit4:junit4]   2> 16497 T715 C39 P36976 /update {wt=javabin&version=2} {add=[122 (1420225610990485504)]} 0 13
[junit4:junit4]   2> 16504 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16504 T729 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16505 T745 C38 P59573 /update {wt=javabin&version=2} {add=[122]} 0 6
[junit4:junit4]   2> 16508 T713 C39 P36976 /update {wt=javabin&version=2} {add=[123 (1420225611014602752)]} 0 1
[junit4:junit4]   2> 16513 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16513 T731 C36 P40178 /update {wt=javabin&version=2} {add=[123 (1420225611017748480)]} 0 3
[junit4:junit4]   2> 16516 T712 C39 P36976 /update {wt=javabin&version=2} {add=[124 (1420225611024039936)]} 0 1
[junit4:junit4]   2> 16523 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16524 T732 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16525 T742 C38 P59573 /update {wt=javabin&version=2} {add=[124]} 0 7
[junit4:junit4]   2> 16527 T714 C39 P36976 /update {wt=javabin&version=2} {add=[125 (1420225611035574272)]} 0 0
[junit4:junit4]   2> 16534 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16534 T730 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16535 T743 C38 P59573 /update {wt=javabin&version=2} {add=[125]} 0 6
[junit4:junit4]   2> 16538 T715 C39 P36976 /update {wt=javabin&version=2} {add=[126 (1420225611046060032)]} 0 1
[junit4:junit4]   2> 16544 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16544 T744 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16545 T729 C36 P40178 /update {wt=javabin&version=2} {add=[126]} 0 5
[junit4:junit4]   2> 16548 T713 C39 P36976 /update {wt=javabin&version=2} {add=[127 (1420225611056545792)]} 0 1
[junit4:junit4]   2> 16571 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=12 
[junit4:junit4]   2> 16572 T742 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=21 
[junit4:junit4]   2> 16572 T731 C36 P40178 /update {wt=javabin&version=2} {add=[127]} 0 22
[junit4:junit4]   2> 16575 T712 C39 P36976 /update {wt=javabin&version=2} {add=[128 (1420225611085905920)]} 0 0
[junit4:junit4]   2> 16583 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16584 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16584 T732 C36 P40178 /update {wt=javabin&version=2} {add=[128]} 0 7
[junit4:junit4]   2> 16587 T714 C39 P36976 /update {wt=javabin&version=2} {add=[129 (1420225611097440256)]} 0 1
[junit4:junit4]   2> 16594 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16594 T730 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16595 T745 C38 P59573 /update {wt=javabin&version=2} {add=[129]} 0 6
[junit4:junit4]   2> 16598 T715 C39 P36976 /update {wt=javabin&version=2} {add=[130 (1420225611108974592)]} 0 1
[junit4:junit4]   2> 16602 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16603 T744 C38 P59573 /update {wt=javabin&version=2} {add=[130 (1420225611112120320)]} 0 3
[junit4:junit4]   2> 16605 T713 C39 P36976 /update {wt=javabin&version=2} {add=[131 (1420225611117363200)]} 0 0
[junit4:junit4]   2> 16610 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16610 T742 C38 P59573 /update {wt=javabin&version=2} {add=[131 (1420225611119460352)]} 0 3
[junit4:junit4]   2> 16618 T712 C39 P36976 /update {wt=javabin&version=2} {add=[132 (1420225611125751808)]} 0 6
[junit4:junit4]   2> 16623 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16623 T729 C36 P40178 /update {wt=javabin&version=2} {add=[132 (1420225611133091840)]} 0 3
[junit4:junit4]   2> 16626 T715 C39 P36976 /update {wt=javabin&version=2} {add=[133 (1420225611138334720)]} 0 1
[junit4:junit4]   2> 16632 T755 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16633 T731 C36 P40178 /update {wt=javabin&version=2} {add=[133 (1420225611142529024)]} 0 4
[junit4:junit4]   2> 16647 T713 C39 P36976 /update {wt=javabin&version=2} {add=[134 (1420225611148820480)]} 0 12
[junit4:junit4]   2> 16656 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16656 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16657 T732 C36 P40178 /update {wt=javabin&version=2} {add=[134]} 0 7
[junit4:junit4]   2> 16660 T714 C39 P36976 /update {wt=javabin&version=2} {add=[135 (1420225611173986304)]} 0 1
[junit4:junit4]   2> 16667 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16667 T730 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16668 T745 C38 P59573 /update {wt=javabin&version=2} {add=[135]} 0 6
[junit4:junit4]   2> 16671 T712 C39 P36976 /update {wt=javabin&version=2} {add=[136 (1420225611185520640)]} 0 1
[junit4:junit4]   2> 16676 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16677 T744 C38 P59573 /update {wt=javabin&version=2} {add=[136 (1420225611188666368)]} 0 4
[junit4:junit4]   2> 16679 T715 C39 P36976 /update {wt=javabin&version=2} {add=[137 (1420225611194957824)]} 0 0
[junit4:junit4]   2> 16686 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16687 T742 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16687 T729 C36 P40178 /update {wt=javabin&version=2} {add=[137]} 0 6
[junit4:junit4]   2> 16690 T713 C39 P36976 /update {wt=javabin&version=2} {add=[138 (1420225611205443584)]} 0 1
[junit4:junit4]   2> 16707 T756 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 16708 T731 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=15 
[junit4:junit4]   2> 16709 T743 C38 P59573 /update {wt=javabin&version=2} {add=[138]} 0 17
[junit4:junit4]   2> 16712 T714 C39 P36976 /update {wt=javabin&version=2} {add=[139 (1420225611228512256)]} 0 1
[junit4:junit4]   2> 16719 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16720 T745 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16721 T730 C36 P40178 /update {wt=javabin&version=2} {add=[139]} 0 7
[junit4:junit4]   2> 16724 T712 C39 P36976 /update {wt=javabin&version=2} {add=[140 (1420225611241095168)]} 0 1
[junit4:junit4]   2> 16729 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16729 T744 C38 P59573 /update {wt=javabin&version=2} {add=[140 (1420225611244240896)]} 0 3
[junit4:junit4]   2> 16744 T715 C39 P36976 /update {wt=javabin&version=2} {add=[141 (1420225611262066688)]} 0 1
[junit4:junit4]   2> 16749 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16749 T742 C38 P59573 /update {wt=javabin&version=2} {add=[141 (1420225611265212416)]} 0 3
[junit4:junit4]   2> 16759 T713 C39 P36976 /update {wt=javabin&version=2} {add=[142 (1420225611271503872)]} 0 8
[junit4:junit4]   2> 16776 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 16776 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=12 
[junit4:junit4]   2> 16777 T729 C36 P40178 /update {wt=javabin&version=2} {add=[142]} 0 15
[junit4:junit4]   2> 16780 T714 C39 P36976 /update {wt=javabin&version=2} {add=[143 (1420225611299815424)]} 0 1
[junit4:junit4]   2> 16787 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16788 T745 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16800 T732 C36 P40178 /update {wt=javabin&version=2} {add=[143]} 0 18
[junit4:junit4]   2> 16804 T715 C39 P36976 /update {wt=javabin&version=2} {add=[144 (1420225611324981248)]} 0 1
[junit4:junit4]   2> 16810 T772 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16810 T744 C38 P59573 /update {wt=javabin&version=2} {add=[144 (1420225611329175552)]} 0 4
[junit4:junit4]   2> 16813 T713 C39 P36976 /update {wt=javabin&version=2} {add=[145 (1420225611335467008)]} 0 1
[junit4:junit4]   2> 16820 T773 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16821 T742 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16822 T731 C36 P40178 /update {wt=javabin&version=2} {add=[145]} 0 7
[junit4:junit4]   2> 16824 T714 C39 P36976 /update {wt=javabin&version=2} {add=[146 (1420225611347001344)]} 0 0
[junit4:junit4]   2> 16831 T757 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16831 T730 C36 P40178 /update {wt=javabin&version=2} {add=[146 (1420225611350147072)]} 0 5
[junit4:junit4]   2> 16834 T712 C39 P36976 /update {wt=javabin&version=2} {add=[147 (1420225611357487104)]} 0 1
[junit4:junit4]   2> 16841 T771 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16841 T743 C38 P59573 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16842 T732 C36 P40178 /update {wt=javabin&version=2} {add=[147]} 0 6
[junit4:junit4]   2> 16845 T715 C39 P36976 /update {wt=javabin&version=2} {add=[148 (1420225611367972864)]} 0 1
[junit4:junit4]   2> 16852 T758 C35 P32792 REQ /update {distrib.from=http://127.0.0.1:40178/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16852 T731 C36 P40178 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 16853 T745 C38 P59573 /update {wt=javabin&version=2} {add=[148]} 0 6
[junit4:junit4]   2> 16856 T713 C39 P36976 /update {wt=javabin&version=2} {add=[149 (1420225611379507200)]} 0 1
[junit4:junit4]   2> 16860 T770 C37 P57908 REQ /update {distrib.from=http://127.0.0.1:59573/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16861 T742 C38 P59573 /update {wt=javabin&version=2} {add=[149 (1420225611382652928)]} 0 3
[junit4:junit4]   2> 16863 T714 C39 P36976 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 17041 T714 C39 P36976 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e28c9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354432672224/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e28c9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_5_nrm.cfe, _1_NestedPulsing_0.tip, _2_NestedPulsing_0.tim, _5_NestedPulsing_0.tip, _6_MockFixedIntBlock_0.pyl, _5_NestedPulsing_0.tim, _2_Asserting_0.pos, _6_MockFixedIntBlock_0.frq, _3.fdt, _0_MockFixedIntBlock_0.tib, _1_MockRandom_0.pos, _6_MockFixedIntBlock_0.skp, _1_Asserting_0.tim, _1_Asserting_0.tip, _0_MockFixedIntBlock_0.tii, _6_NestedPulsing_0.doc, _3_MockRandom_0.skp, _4_MockRandom_0.pyl, _1_NestedPulsing_0.tim, _2_NestedPulsing_0.tip, _5_MockRandom_0.pos, _5_NestedPulsing_0.pos, _5_Asserting_0.pos, _0_NestedPulsing_0.doc, _1_MockRandom_0.tiv, _4_MockFixedIntBlock_0.pos, _1_NestedPulsing_0.pos, _2.fdt, _3_NestedPulsing_0.tim, _1_MockRandom_0.sd, _2.fdx, _1.fdx, _2_Asserting_0.tim, _1_MockRandom_0.tib, _2_Asserting_0.tip, _5_nrm.cfs, _3_NestedPulsing_0.tip, _1.fdt, _4_MockRandom_0.sd, _4_MockFixedIntBlock_0.frq, _3.si, _1_MockRandom_0.doc, _2_MockFixedIntBlock_0.doc, _1_MockFixedIntBlock_0.pos, _6.fdt, _0_Asserting_0.tim, _2.si, _6_MockRandom_0.tip, _0_Asserting_0.tip, _3_MockFixedIntBlock_0.frq, _6_MockRandom_0.tim, _6.fdx, _2_MockFixedIntBlock_0.skp, _4_Asserting_0.tip, _3_MockRandom_0.frq, _6_MockFixedIntBlock_0.tib, _3.fnm, _6_MockFixedIntBlock_0.tii, _0_NestedPulsing_0.tip, _3_Asserting_0.pos, _2_MockRandom_0.tiv, _0_NestedPulsing_0.tim, _5_Asserting_0.doc, _4_Asserting_0.pos, _2_nrm.cfe, _0_MockFixedIntBlock_0.pyl, _4_Asserting_0.tim, _2_Asserting_0.doc, _4_NestedPulsing_0.tip, _6_MockRandom_0.doc, _4_NestedPulsing_0.tim, _2_MockRandom_0.tib, _2_nrm.cfs, _5_MockRandom_0.doc, _4_MockRandom_0.skp, _6_MockFixedIntBlock_0.doc, _5_MockFixedIntBlock_0.frq, _4_NestedPulsing_0.pos, _5_MockFixedIntBlock_0.tib, _3_MockFixedIntBlock_0.pos, _2.fnm, _3_NestedPulsing_0.doc, _3.fdx, _2_MockRandom_0.sd, _0_MockFixedIntBlock_0.doc, _3_Asserting_0.doc, _1.si, _6_NestedPulsing_0.tip, _3_MockRandom_0.pyl, _6.si, _6.fnm, _0_Asserting_0.pos, _3_MockRandom_0.pos, _2_MockRandom_0.doc, _6_NestedPulsing_0.tim, _5_MockFixedIntBlock_0.tii, _4_MockRandom_0.pos, _3_nrm.cfe, _5.fdt, _4_MockFixedIntBlock_0.tib, _3_MockFixedIntBlock_0.skp, _4_NestedPulsing_0.doc, _1_MockFixedIntBlock_0.pyl, _4_nrm.cfe, _4.fnm, _1.fnm, _2_MockFixedIntBlock_0.tii, _4.fdx, 

[...truncated too long message...]

shard1",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"down",
[junit4:junit4]   1>                 "core":"multiunload20",
[junit4:junit4]   1>                 "collection":"multiunload2",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:40178_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:40178/solr",
[junit4:junit4]   1>                 "leader":"true"},
[junit4:junit4]   1>               "127.0.0.1:40178_solr_multiunload22":{
[junit4:junit4]   1>                 "shard":"shard1",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"down",
[junit4:junit4]   1>                 "core":"multiunload22",
[junit4:junit4]   1>                 "collection":"multiunload2",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:40178_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:40178/solr"},
[junit4:junit4]   1>               "127.0.0.1:40178_solr_multiunload21":{
[junit4:junit4]   1>                 "shard":"shard1",
[junit4:junit4]   1>                 "roles":null,
[junit4:junit4]   1>                 "state":"down",
[junit4:junit4]   1>                 "core":"multiunload21",
[junit4:junit4]   1>                 "collection":"multiunload2",
[junit4:junit4]   1>                 "node_name":"127.0.0.1:40178_solr",
[junit4:junit4]   1>                 "base_url":"http://127.0.0.1:40178/solr"}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> 294727 T697 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 294780 T700 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 295198 T747 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 295198 T747 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 295199 T747 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 295199 T747 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 295199 T747 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 295540 T775 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 295540 T775 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 295540 T775 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 295541 T775 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 415912 T697 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=1527 closes=1526
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=MockRandom), cat=PostingsFormat(name=Asserting), foo_d=MockFixedIntBlock(blockSize=1133), foo_f=PostingsFormat(name=MockRandom), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=PostingsFormat(name=Asserting), rnd_b=MockFixedIntBlock(blockSize=1133), intDefault=PostingsFormat(name=Asserting), n_td1=PostingsFormat(name=NestedPulsing), timestamp=PostingsFormat(name=Asserting), id=MockFixedIntBlock(blockSize=1133), range_facet_sl=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=NestedPulsing), oddField_s=PostingsFormat(name=MockRandom), sequence_i=PostingsFormat(name=MockRandom), name=MockFixedIntBlock(blockSize=1133), foo_i=PostingsFormat(name=NestedPulsing), regex_dup_B_s=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=NestedPulsing), n_tf1=PostingsFormat(name=Asserting), n_dt1=PostingsFormat(name=NestedPulsing), genre_s=PostingsFormat(name=MockRandom), author_t=PostingsFormat(name=NestedPulsing), n_ti1=MockFixedIntBlock(blockSize=1133), range_facet_l=PostingsFormat(name=Asserting), text=PostingsFormat(name=MockRandom), _version_=PostingsFormat(name=Asserting), val_i=MockFixedIntBlock(blockSize=1133), SubjectTerms_mfacet=PostingsFormat(name=Asserting), series_t=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=Asserting), n_tdt1=PostingsFormat(name=Asserting), regex_dup_A_s=PostingsFormat(name=MockRandom), price=PostingsFormat(name=MockRandom), other_tl1=PostingsFormat(name=Asserting), n_l1=PostingsFormat(name=Asserting), a_si=PostingsFormat(name=NestedPulsing), inStock=PostingsFormat(name=MockRandom)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=mk, timezone=Europe/Vaduz
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=1,free=148787488,total=518979584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestNumberUtils, TestFaceting, SpellCheckCollatorTest, TestSystemIdResolver, SampleTest, NumericFieldsTest, ClusterStateUpdateTest, TestWordDelimiterFilterFactory, TestCoreContainer, CopyFieldTest, PathHierarchyTokenizerFactoryTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrIndexConfig, TestJoin, ResourceLoaderTest, QueryElevationComponentTest, TestIndexingPerformance, UniqFieldsUpdateProcessorFactoryTest, DistributedSpellCheckComponentTest, SolrCmdDistributorTest, TestRandomFaceting, CacheHeaderTest, TestLFUCache, TestRangeQuery, BasicDistributedZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=AFD96FBECF210FAA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=Europe/Vaduz -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1527 closes=1526
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([AFD96FBECF210FAA]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:243)
[junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] Completed on J0 in 416.01s, 1 test, 1 failure <<< FAILURES!

[...truncated 123 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:335: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1163: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:827: There were test failures: 236 suites, 980 tests, 1 suite-level error, 7 ignored (2 assumptions)

Total time: 33 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure