You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@sd-datasolutions.de> on 2012/12/06 13:24:36 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_09) - Build # 3087 - Still Failing!

Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux/3087/
Java: 32bit/jdk1.7.0_09 -client -XX:+UseParallelGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.RecoveryZkTest

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=474, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=474, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
	at __randomizedtesting.SeedInfo.seed([3886DB3474318611]:0)
	at java.lang.Thread.getStackTrace(Thread.java:1567)
	at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
	at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:515)
	at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:981)
	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:873)
	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:865)
	at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:33)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:232)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:192)
	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:374)
	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:273)
	at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:152)
	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:407)
	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:222)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/index7404574064tmp lockFactory=org.apache.lucene.store.SimpleFSLockFactory@4e52d9)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
	at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8585 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4]   2> 3 T421 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-RecoveryZkTest-1354796146085
[junit4:junit4]   2> 3 T421 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T422 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T422 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 5 T422 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 5 T422 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T422 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6 T422 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 104 T421 oasc.ZkTestServer.run start zk server on port:34320
[junit4:junit4]   2> 104 T421 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34320 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16c9bab
[junit4:junit4]   2> 105 T421 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 105 T427 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34320. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 106 T427 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34320, initiating session
[junit4:junit4]   2> 106 T423 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47228
[junit4:junit4]   2> 106 T423 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47228
[junit4:junit4]   2> 106 T425 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 203 T425 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b70249da90000 with negotiated timeout 10000 for client /127.0.0.1:47228
[junit4:junit4]   2> 203 T427 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34320, sessionid = 0x13b70249da90000, negotiated timeout = 10000
[junit4:junit4]   2> 204 T428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16c9bab name:ZooKeeperConnection Watcher:127.0.0.1:34320 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 204 T421 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 204 T421 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 207 T426 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b70249da90000
[junit4:junit4]   2> 208 T423 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47228 which had sessionid 0x13b70249da90000
[junit4:junit4]   2> 209 T428 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 209 T421 oaz.ZooKeeper.close Session: 0x13b70249da90000 closed
[junit4:junit4]   2> 209 T421 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34320/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@c0fca2
[junit4:junit4]   2> 210 T421 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 210 T429 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34320. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 211 T429 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34320, initiating session
[junit4:junit4]   2> 211 T423 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47229
[junit4:junit4]   2> 211 T423 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47229
[junit4:junit4]   2> 212 T425 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b70249da90001 with negotiated timeout 10000 for client /127.0.0.1:47229
[junit4:junit4]   2> 212 T429 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34320, sessionid = 0x13b70249da90001, negotiated timeout = 10000
[junit4:junit4]   2> 213 T430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c0fca2 name:ZooKeeperConnection Watcher:127.0.0.1:34320/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 213 T421 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 213 T421 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 219 T421 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 221 T421 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 222 T421 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 224 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 225 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 229 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 230 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 233 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 234 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 236 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 237 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 238 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 239 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 241 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 242 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 243 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 244 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 246 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 246 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 249 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 249 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 251 T421 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 252 T421 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 254 T426 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b70249da90001
[junit4:junit4]   2> 254 T430 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 254 T423 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47229 which had sessionid 0x13b70249da90001
[junit4:junit4]   2> 254 T421 oaz.ZooKeeper.close Session: 0x13b70249da90001 closed
[junit4:junit4]   2> 314 T421 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 320 T421 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:33580
[junit4:junit4]   2> 321 T421 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 322 T421 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337
[junit4:junit4]   2> 322 T421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/'
[junit4:junit4]   2> 334 T421 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 335 T421 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 335 T421 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337
[junit4:junit4]   2> 335 T421 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/solr.xml
[junit4:junit4]   2> 336 T421 oasc.CoreContainer.<init> New CoreContainer 8587751
[junit4:junit4]   2> 336 T421 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/'
[junit4:junit4]   2> 336 T421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/'
[junit4:junit4]   2> 350 T421 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 360 T421 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34320/solr
[junit4:junit4]   2> 361 T421 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34320/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ef16ee
[junit4:junit4]   2> 362 T421 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 362 T440 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34320. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 362 T440 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34320, initiating session
[junit4:junit4]   2> 363 T423 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47230
[junit4:junit4]   2> 363 T423 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47230
[junit4:junit4]   2> 364 T425 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b70249da90002 with negotiated timeout 8000 for client /127.0.0.1:47230
[junit4:junit4]   2> 364 T440 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34320, sessionid = 0x13b70249da90002, negotiated timeout = 8000
[junit4:junit4]   2> 364 T441 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ef16ee name:ZooKeeperConnection Watcher:127.0.0.1:34320/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 364 T421 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 366 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x2 zxid:0x19 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 367 T421 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 369 T421 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33580_solr
[junit4:junit4]   2> 369 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:delete cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33580_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33580_solr
[junit4:junit4]   2> 370 T421 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33580_solr
[junit4:junit4]   2> 372 T421 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 372 T421 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 373 T421 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 373 T421 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 374 T421 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 374 T421 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 375 T421 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 375 T421 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 375 T421 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 376 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 383 T421 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 387 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:delete cxid:0x15 zxid:0x20 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 387 T421 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 389 T421 oasc.Overseer.start Overseer (id=88787920230088706-127.0.0.1:33580_solr-n_0000000000) starting
[junit4:junit4]   2> 390 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x1a zxid:0x22 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 391 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 393 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 393 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 394 T443 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 394 T421 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 396 T421 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 398 T442 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 401 T444 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/collection1
[junit4:junit4]   2> 401 T444 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 402 T444 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 402 T444 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 403 T444 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/collection1/'
[junit4:junit4]   2> 404 T444 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/collection1/lib/README' to classloader
[junit4:junit4]   2> 404 T444 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 436 T444 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 482 T444 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 483 T444 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 488 T444 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 914 T444 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 920 T444 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 923 T444 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 933 T444 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 936 T444 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 939 T444 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 940 T444 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 941 T444 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1354796146337/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data/
[junit4:junit4]   2> 942 T444 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd6de
[junit4:junit4]   2> 942 T444 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 943 T444 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/index7404574061tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b42030) assuming 'simple'
[junit4:junit4]   2> 944 T444 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data forceNew:false
[junit4:junit4]   2> 944 T444 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data
[junit4:junit4]   2> 944 T444 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data/index/
[junit4:junit4]   2> 944 T444 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 945 T444 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data/index forceNew:false
[junit4:junit4]   2> 946 T444 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@15bdeaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1321590),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 946 T444 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 946 T444 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data/index
[junit4:junit4]   2> 947 T444 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 948 T444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 949 T444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 949 T444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 949 T444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 950 T444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 950 T444 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 950 T444 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 951 T444 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 951 T444 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 952 T444 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 953 T444 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 953 T444 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 953 T444 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 954 T444 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 954 T444 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 954 T444 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 955 T444 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 956 T444 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 957 T444 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 958 T444 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 958 T444 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 959 T444 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 959 T444 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 960 T444 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 961 T444 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 964 T444 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 966 T444 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 967 T444 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 969 T444 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data
[junit4:junit4]   2> 969 T444 oass.SolrIndexSearcher.<init> Opening Searcher@b94f9a main
[junit4:junit4]   2> 970 T444 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 970 T444 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 971 T444 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 975 T444 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 999 T445 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b94f9a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1002 T444 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1003 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x53 zxid:0x28 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1402 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1403 T442 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33580_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33580/solr"}
[junit4:junit4]   2> 1403 T442 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 1403 T442 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1403 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x5b zxid:0x2b txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1407 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1505 T444 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1505 T444 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:33580/solr shardId:shard1
[junit4:junit4]   2> 1506 T444 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 1512 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:delete cxid:0x75 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 1512 T444 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 1513 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x76 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1514 T444 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1514 T444 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1514 T444 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33580/solr/collection1/
[junit4:junit4]   2> 1514 T444 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1515 T444 oasc.SyncStrategy.syncToMe http://127.0.0.1:33580/solr/collection1/ has no replicas
[junit4:junit4]   2> 1515 T444 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33580/solr/collection1/
[junit4:junit4]   2> 1515 T444 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 1517 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90002 type:create cxid:0x80 zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1910 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1915 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 1919 T444 oasc.ZkController.register We are http://127.0.0.1:33580/solr/collection1/ and leader is http://127.0.0.1:33580/solr/collection1/
[junit4:junit4]   2> 1920 T444 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33580/solr
[junit4:junit4]   2> 1920 T444 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1920 T444 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1921 T444 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1922 T421 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 1922 T421 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1922 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1925 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 1928 T421 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34320/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@be6bc5
[junit4:junit4]   2> 1928 T421 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1928 T446 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34320. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1929 T446 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34320, initiating session
[junit4:junit4]   2> 1929 T423 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47231
[junit4:junit4]   2> 1929 T423 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47231
[junit4:junit4]   2> 1930 T425 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b70249da90003 with negotiated timeout 10000 for client /127.0.0.1:47231
[junit4:junit4]   2> 1930 T446 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34320, sessionid = 0x13b70249da90003, negotiated timeout = 10000
[junit4:junit4]   2> 1931 T447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@be6bc5 name:ZooKeeperConnection Watcher:127.0.0.1:34320/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1931 T421 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1932 T421 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1933 T421 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 1988 T421 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 1994 T421 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:57664
[junit4:junit4]   2> 1995 T421 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1995 T421 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015
[junit4:junit4]   2> 1996 T421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/'
[junit4:junit4]   2> 2009 T421 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2010 T421 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2010 T421 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015
[junit4:junit4]   2> 2011 T421 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/solr.xml
[junit4:junit4]   2> 2011 T421 oasc.CoreContainer.<init> New CoreContainer 23596510
[junit4:junit4]   2> 2011 T421 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/'
[junit4:junit4]   2> 2012 T421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/'
[junit4:junit4]   2> 2026 T421 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2036 T421 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34320/solr
[junit4:junit4]   2> 2037 T421 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34320/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e41edb
[junit4:junit4]   2> 2037 T421 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2038 T457 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34320. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2038 T457 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34320, initiating session
[junit4:junit4]   2> 2038 T423 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47232
[junit4:junit4]   2> 2039 T423 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47232
[junit4:junit4]   2> 2039 T425 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b70249da90004 with negotiated timeout 8000 for client /127.0.0.1:47232
[junit4:junit4]   2> 2039 T457 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34320, sessionid = 0x13b70249da90004, negotiated timeout = 8000
[junit4:junit4]   2> 2040 T458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e41edb name:ZooKeeperConnection Watcher:127.0.0.1:34320/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2040 T421 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2041 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90004 type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2041 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90004 type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2042 T421 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57664_solr
[junit4:junit4]   2> 2043 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90004 type:delete cxid:0x4 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57664_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57664_solr
[junit4:junit4]   2> 2043 T421 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57664_solr
[junit4:junit4]   2> 2045 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2045 T447 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2046 T421 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2046 T441 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2046 T421 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2047 T421 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2047 T421 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2047 T421 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2048 T421 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2048 T421 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2048 T421 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2049 T421 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2049 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2054 T421 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2060 T459 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/collection1
[junit4:junit4]   2> 2060 T459 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2061 T459 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2061 T459 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2062 T459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/collection1/'
[junit4:junit4]   2> 2062 T459 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/collection1/lib/README' to classloader
[junit4:junit4]   2> 2063 T459 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2094 T459 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2143 T459 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2144 T459 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2148 T459 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2419 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2420 T442 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33580_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33580/solr"}
[junit4:junit4]   2> 2426 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2426 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2427 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2551 T459 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2559 T459 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2562 T459 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2571 T459 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2575 T459 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2578 T459 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2579 T459 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2580 T459 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1354796148015/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1/
[junit4:junit4]   2> 2581 T459 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd6de
[junit4:junit4]   2> 2581 T459 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2582 T459 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/index7404574062tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@fbcc01) assuming 'simple'
[junit4:junit4]   2> 2583 T459 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1 forceNew:false
[junit4:junit4]   2> 2584 T459 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1
[junit4:junit4]   2> 2584 T459 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1/index/
[junit4:junit4]   2> 2584 T459 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2585 T459 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1/index forceNew:false
[junit4:junit4]   2> 2587 T459 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19f862f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2589 T459 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2589 T459 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1/index
[junit4:junit4]   2> 2589 T459 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 2591 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2591 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 2592 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2592 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 2592 T459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2593 T459 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2593 T459 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2594 T459 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2594 T459 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2595 T459 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 2596 T459 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 2596 T459 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2597 T459 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2597 T459 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2597 T459 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2598 T459 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2599 T459 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2599 T459 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2600 T459 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2601 T459 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2602 T459 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2603 T459 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2604 T459 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2605 T459 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2606 T459 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2609 T459 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2611 T459 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2612 T459 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2613 T459 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1
[junit4:junit4]   2> 2614 T459 oass.SolrIndexSearcher.<init> Opening Searcher@12bdfbf main
[junit4:junit4]   2> 2614 T459 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2614 T459 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2615 T459 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2619 T459 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2641 T460 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12bdfbf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2647 T459 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2930 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2931 T442 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57664_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57664/solr"}
[junit4:junit4]   2> 2931 T442 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 2931 T442 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2934 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2934 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 2934 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3148 T459 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 3149 T459 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:57664/solr shardId:shard1
[junit4:junit4]   2> 3150 T459 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3159 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90004 type:delete cxid:0x45 zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3160 T459 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3161 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90004 type:create cxid:0x46 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3164 T459 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3164 T459 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3165 T459 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57664/solr/collection1/
[junit4:junit4]   2> 3165 T459 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3166 T459 oasc.SyncStrategy.syncToMe http://127.0.0.1:57664/solr/collection1/ has no replicas
[junit4:junit4]   2> 3167 T459 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57664/solr/collection1/
[junit4:junit4]   2> 3167 T459 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3173 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90004 type:create cxid:0x50 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3438 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3448 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3448 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3448 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3477 T459 oasc.ZkController.register We are http://127.0.0.1:57664/solr/collection1/ and leader is http://127.0.0.1:57664/solr/collection1/
[junit4:junit4]   2> 3477 T459 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57664/solr
[junit4:junit4]   2> 3477 T459 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3477 T459 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3478 T459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3479 T421 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3480 T421 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3480 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3542 T421 oejs.Server.doStart jetty-8.1.7.v20120910
[junit4:junit4]   2> 3544 T421 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:45028
[junit4:junit4]   2> 3545 T421 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3545 T421 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566
[junit4:junit4]   2> 3546 T421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/'
[junit4:junit4]   2> 3560 T421 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3561 T421 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3561 T421 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566
[junit4:junit4]   2> 3561 T421 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/solr.xml
[junit4:junit4]   2> 3562 T421 oasc.CoreContainer.<init> New CoreContainer 28136669
[junit4:junit4]   2> 3562 T421 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/'
[junit4:junit4]   2> 3562 T421 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/'
[junit4:junit4]   2> 3578 T421 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3588 T421 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:34320/solr
[junit4:junit4]   2> 3589 T421 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:34320/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@b5cd7f
[junit4:junit4]   2> 3590 T421 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3590 T470 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:34320. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3591 T470 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:34320, initiating session
[junit4:junit4]   2> 3591 T423 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47233
[junit4:junit4]   2> 3591 T423 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47233
[junit4:junit4]   2> 3592 T425 oazs.ZooKeeperServer.finishSessionInit Established session 0x13b70249da90005 with negotiated timeout 8000 for client /127.0.0.1:47233
[junit4:junit4]   2> 3592 T470 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:34320, sessionid = 0x13b70249da90005, negotiated timeout = 8000
[junit4:junit4]   2> 3592 T471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b5cd7f name:ZooKeeperConnection Watcher:127.0.0.1:34320/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3592 T421 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3593 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90005 type:create cxid:0x1 zxid:0x68 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3594 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90005 type:create cxid:0x2 zxid:0x69 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3594 T421 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45028_solr
[junit4:junit4]   2> 3595 T426 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13b70249da90005 type:delete cxid:0x4 zxid:0x6a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45028_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45028_solr
[junit4:junit4]   2> 3595 T421 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45028_solr
[junit4:junit4]   2> 3597 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 3597 T458 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3598 T447 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3598 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3598 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3599 T441 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3598 T421 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3599 T421 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3599 T421 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3600 T421 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3600 T421 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3600 T421 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3601 T421 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3601 T421 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3602 T421 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3602 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3608 T421 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3614 T472 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/collection1
[junit4:junit4]   2> 3614 T472 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3615 T472 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3615 T472 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3616 T472 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/collection1/'
[junit4:junit4]   2> 3617 T472 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/collection1/lib/README' to classloader
[junit4:junit4]   2> 3617 T472 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3649 T472 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3700 T472 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3701 T472 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3705 T472 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3958 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3958 T442 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:57664_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:57664/solr"}
[junit4:junit4]   2> 3971 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3971 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3971 T471 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 3971 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4094 T472 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4101 T472 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4104 T472 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4112 T472 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4115 T472 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4119 T472 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4120 T472 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4121 T472 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1354796149566/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/
[junit4:junit4]   2> 4121 T472 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd6de
[junit4:junit4]   2> 4122 T472 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 4123 T472 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/index7404574063tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@10253cb) assuming 'simple'
[junit4:junit4]   2> 4123 T472 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2 forceNew:false
[junit4:junit4]   2> 4124 T472 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2
[junit4:junit4]   2> 4124 T472 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/index/
[junit4:junit4]   2> 4124 T472 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4125 T472 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/index forceNew:false
[junit4:junit4]   2> 4126 T472 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@26c225 lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c3ff8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4126 T472 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4126 T472 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/index
[junit4:junit4]   2> 4127 T472 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4128 T472 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4128 T472 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4128 T472 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4129 T472 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4129 T472 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4129 T472 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4129 T472 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4130 T472 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4131 T472 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4131 T472 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4132 T472 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4132 T472 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4133 T472 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4133 T472 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4134 T472 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4134 T472 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4135 T472 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4136 T472 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4136 T472 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4137 T472 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4138 T472 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4138 T472 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4139 T472 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4140 T472 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4141 T472 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4143 T472 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4145 T472 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4147 T472 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4148 T472 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2
[junit4:junit4]   2> 4149 T472 oass.SolrIndexSearcher.<init> Opening Searcher@1643fac main
[junit4:junit4]   2> 4149 T472 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4150 T472 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4150 T472 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4154 T472 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4175 T473 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1643fac main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4180 T472 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4476 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4478 T442 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45028_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45028/solr"}
[junit4:junit4]   2> 4478 T442 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 4478 T442 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4484 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4484 T471 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4484 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4484 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4681 T472 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4681 T472 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:45028/solr shardId:shard1
[junit4:junit4]   2> 4684 T472 oasc.ZkController.register We are http://127.0.0.1:45028/solr/collection1/ and leader is http://127.0.0.1:57664/solr/collection1/
[junit4:junit4]   2> 4684 T472 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45028/solr
[junit4:junit4]   2> 4684 T472 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 4684 T472 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C56 name=collection1 org.apache.solr.core.SolrCore@955821 url=http://127.0.0.1:45028/solr/collection1 node=127.0.0.1:45028_solr
[junit4:junit4]   2> 4685 T474 C56 P45028 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 4685 T472 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4685 T474 C56 P45028 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 4685 T474 C56 P45028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4686 T421 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 4686 T474 C56 P45028 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57664/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 4687 T474 C56 P45028 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45028/solr START replicas=[http://127.0.0.1:57664/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 4686 T421 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4687 T474 C56 P45028 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 4687 T421 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4688 T474 C56 P45028 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 4688 T474 C56 P45028 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 4688 T474 C56 P45028 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4691 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C57 name=collection1 org.apache.solr.core.SolrCore@73135b url=http://127.0.0.1:57664/solr/collection1 node=127.0.0.1:57664_solr
[junit4:junit4]   2> 4692 T455 C57 P57664 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> ASYNC  NEW_CORE C58 name=collection1 org.apache.solr.core.SolrCore@1dcf664 url=http://127.0.0.1:33580/solr/collection1 node=127.0.0.1:33580_solr
[junit4:junit4]   2> 4700 T437 C58 P33580 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/control/data
[junit4:junit4]   2> 4702 T437 C58 P33580 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@15bdeaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1321590),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4702 T437 C58 P33580 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4708 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10001 (1420606728603435008)]} 0 7
[junit4:junit4]   2> 4708 T437 C58 P33580 /update {wt=javabin&version=2} {add=[1 (1420606728602386432)]} 0 8
[junit4:junit4]   2> 4710 T454 C57 P57664 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty1
[junit4:junit4]   2> 4712 T454 C57 P57664 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19f862f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4712 T454 C57 P57664 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4714 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10001 (1420606728613920768)]} 0 3
[junit4:junit4]   2> 4714 T454 C57 P57664 /update {wt=javabin&version=2} {add=[1 (1420606728612872192)]} 0 4
[junit4:junit4]   2> 4717 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10001 (-1420606728619163649)]} 0 1
[junit4:junit4]   2> 4717 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[1 (-1420606728619163648)]} 0 1
[junit4:junit4]   2> 4719 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10001 (-1420606728622309376)]} 0 0
[junit4:junit4]   2> 4719 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[1 (-1420606728622309377)]} 0 0
[junit4:junit4]   2> 4723 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10002 (1420606728625455104)]} 0 1
[junit4:junit4]   2> 4723 T438 C58 P33580 /update {wt=javabin&version=2} {add=[2 (1420606728625455105)]} 0 1
[junit4:junit4]   2> 4725 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10002 (1420606728628600833)]} 0 0
[junit4:junit4]   2> 4726 T455 C57 P57664 /update {wt=javabin&version=2} {add=[2 (1420606728628600832)]} 0 1
[junit4:junit4]   2> 4728 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10003 (1420606728631746560)]} 0 1
[junit4:junit4]   2> 4729 T437 C58 P33580 /update {wt=javabin&version=2} {add=[3 (1420606728631746561)]} 0 1
[junit4:junit4]   2> 4731 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10003 (1420606728633843712)]} 0 1
[junit4:junit4]   2> 4732 T454 C57 P57664 /update {wt=javabin&version=2} {add=[3 (1420606728634892288)]} 0 1
[junit4:junit4]   2> 4734 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10004 (1420606728636989440)]} 0 1
[junit4:junit4]   2> 4734 T438 C58 P33580 /update {wt=javabin&version=2} {add=[4 (1420606728638038016)]} 0 0
[junit4:junit4]   2> 4737 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10004 (1420606728640135168)]} 0 1
[junit4:junit4]   2> 4737 T453 C57 P57664 /update {wt=javabin&version=2} {add=[4 (1420606728641183744)]} 0 0
[junit4:junit4]   2> 4739 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10002 (-1420606728643280896)]} 0 0
[junit4:junit4]   2> 4740 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[2 (-1420606728644329472)]} 0 0
[junit4:junit4]   2> 4742 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10002 (-1420606728646426624)]} 0 0
[junit4:junit4]   2> 4743 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[2 (-1420606728647475200)]} 0 0
[junit4:junit4]   2> 4745 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10005 (1420606728648523776)]} 0 1
[junit4:junit4]   2> 4746 T438 C58 P33580 /update {wt=javabin&version=2} {add=[5 (1420606728649572352)]} 0 1
[junit4:junit4]   2> 4749 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10005 (1420606728651669504)]} 0 2
[junit4:junit4]   2> 4750 T454 C57 P57664 /update {wt=javabin&version=2} {add=[5 (1420606728652718080)]} 0 2
[junit4:junit4]   2> 4751 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10004 (-1420606728655863808)]} 0 0
[junit4:junit4]   2> 4752 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[4 (-1420606728656912384)]} 0 0
[junit4:junit4]   2> 4753 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10004 (-1420606728657960960)]} 0 0
[junit4:junit4]   2> 4754 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[4 (-1420606728659009536)]} 0 0
[junit4:junit4]   2> 4757 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10006 (1420606728661106688)]} 0 1
[junit4:junit4]   2> 4757 T438 C58 P33580 /update {wt=javabin&version=2} {add=[6 (1420606728662155264)]} 0 1
[junit4:junit4]   2> 4760 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10006 (1420606728664252416)]} 0 1
[junit4:junit4]   2> 4760 T453 C57 P57664 /update {wt=javabin&version=2} {add=[6 (1420606728664252417)]} 0 1
[junit4:junit4]   2> 4763 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10007 (1420606728667398144)]} 0 1
[junit4:junit4]   2> 4763 T437 C58 P33580 /update {wt=javabin&version=2} {add=[7 (1420606728667398145)]} 0 1
[junit4:junit4]   2> 4765 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10007 (1420606728670543872)]} 0 0
[junit4:junit4]   2> 4766 T454 C57 P57664 /update {wt=javabin&version=2} {add=[7 (1420606728670543873)]} 0 1
[junit4:junit4]   2> 4768 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10005 (-1420606728672641024)]} 0 0
[junit4:junit4]   2> 4768 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[5 (-1420606728673689600)]} 0 0
[junit4:junit4]   2> 4770 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10005 (-1420606728675786752)]} 0 1
[junit4:junit4]   2> 4770 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[5 (-1420606728675786753)]} 0 0
[junit4:junit4]   2> 4774 T437 C58 P33580 /update {wt=javabin&version=2} {add=[8 (1420606728677883905)]} 0 2
[junit4:junit4]   2> 4778 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10008 (1420606728677883904)]} 0 6
[junit4:junit4]   2> 4779 T454 C57 P57664 /update {wt=javabin&version=2} {add=[8 (1420606728682078208)]} 0 3
[junit4:junit4]   2> 4781 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10008 (1420606728686272512)]} 0 1
[junit4:junit4]   2> 4782 T436 C58 P33580 /update {wt=javabin&version=2} {add=[9 (1420606728688369664)]} 0 1
[junit4:junit4]   2> 4784 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10009 (1420606728689418240)]} 0 1
[junit4:junit4]   2> 4785 T455 C57 P57664 /update {wt=javabin&version=2} {add=[9 (1420606728691515392)]} 0 0
[junit4:junit4]   2> 4787 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10009 (1420606728692563968)]} 0 1
[junit4:junit4]   2> 4788 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10 (1420606728694661120)]} 0 0
[junit4:junit4]   2> 4790 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10010 (1420606728695709696)]} 0 1
[junit4:junit4]   2> 4791 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10 (1420606728696758272)]} 0 1
[junit4:junit4]   2> 4793 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10010 (1420606728698855424)]} 0 1
[junit4:junit4]   2> 4794 T436 C58 P33580 /update {wt=javabin&version=2} {add=[11 (1420606728699904000)]} 0 1
[junit4:junit4]   2> 4796 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10011 (1420606728702001152)]} 0 1
[junit4:junit4]   2> 4797 T455 C57 P57664 /update {wt=javabin&version=2} {add=[11 (1420606728703049728)]} 0 1
[junit4:junit4]   2> 4799 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10011 (1420606728705146880)]} 0 1
[junit4:junit4]   2> 4800 T439 C58 P33580 /update {wt=javabin&version=2} {add=[12 (1420606728706195456)]} 0 1
[junit4:junit4]   2> 4802 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10012 (1420606728708292608)]} 0 1
[junit4:junit4]   2> 4803 T455 C57 P57664 /update {wt=javabin&version=2} {add=[12 (1420606728709341184)]} 0 1
[junit4:junit4]   2> 4805 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10012 (1420606728711438336)]} 0 1
[junit4:junit4]   2> 4805 T436 C58 P33580 /update {wt=javabin&version=2} {add=[13 (1420606728712486912)]} 0 0
[junit4:junit4]   2> 4808 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10013 (1420606728714584064)]} 0 1
[junit4:junit4]   2> 4808 T453 C57 P57664 /update {wt=javabin&version=2} {add=[13 (1420606728714584064)]} 0 1
[junit4:junit4]   2> 4810 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[6 (-1420606728717729792)]} 0 0
[junit4:junit4]   2> 4811 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10013 (1420606728717729792)]} 0 1
[junit4:junit4]   2> 4812 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[6 (-1420606728719826944)]} 0 0
[junit4:junit4]   2> 4813 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10006 (-1420606728720875520)]} 0 0
[junit4:junit4]   2> 4815 T436 C58 P33580 /update {wt=javabin&version=2} {add=[14 (1420606728721924096)]} 0 1
[junit4:junit4]   2> 4818 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10006 (-1420606728726118401)]} 0 1
[junit4:junit4]   2> 4818 T455 C57 P57664 /update {wt=javabin&version=2} {add=[14 (1420606728726118400)]} 0 1
[junit4:junit4]   2> 4821 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[7 (-1420606728728215553)]} 0 1
[junit4:junit4]   2> 4821 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10014 (1420606728728215552)]} 0 1
[junit4:junit4]   2> 4823 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[7 (-1420606728731361280)]} 0 0
[junit4:junit4]   2> 4827 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10014 (1420606728731361281)]} 0 4
[junit4:junit4]   2> 4830 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10007 (-1420606728737652736)]} 0 1
[junit4:junit4]   2> 4832 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10007 (-1420606728740798464)]} 0 1
[junit4:junit4]   2> 4834 T437 C58 P33580 /update {wt=javabin&version=2} {add=[15 (1420606728733458432)]} 0 9
[junit4:junit4]   2> 4836 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10015 (1420606728742895616)]} 0 2
[junit4:junit4]   2> 4837 T454 C57 P57664 /update {wt=javabin&version=2} {add=[15 (1420606728746041344)]} 0 1
[junit4:junit4]   2> 4839 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10015 (1420606728747089920)]} 0 1
[junit4:junit4]   2> 4839 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[8 (-1420606728748138496)]} 0 0
[junit4:junit4]   2> 4841 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10008 (-1420606728750235648)]} 0 0
[junit4:junit4]   2> 4842 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[8 (-1420606728750235648)]} 0 1
[junit4:junit4]   2> 4844 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10008 (-1420606728752332800)]} 0 1
[junit4:junit4]   2> 4844 T437 C58 P33580 /update {wt=javabin&version=2} {add=[16 (1420606728753381376)]} 0 1
[junit4:junit4]   2> 4847 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10016 (1420606728755478528)]} 0 1
[junit4:junit4]   2> 4849 T453 C57 P57664 /update {wt=javabin&version=2} {add=[16 (1420606728756527104)]} 0 2
[junit4:junit4]   2> 4851 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[9 (-1420606728760721408)]} 0 0
[junit4:junit4]   2> 4851 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10016 (1420606728759672832)]} 0 1
[junit4:junit4]   2> 4854 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[9 (-1420606728762818560)]} 0 1
[junit4:junit4]   2> 4854 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10009 (-1420606728763867136)]} 0 0
[junit4:junit4]   2> 4856 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10009 (-1420606728765964288)]} 0 0
[junit4:junit4]   2> 4857 T437 C58 P33580 /update {wt=javabin&version=2} {add=[17 (1420606728765964288)]} 0 1
[junit4:junit4]   2> 4859 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10017 (1420606728768061440)]} 0 1
[junit4:junit4]   2> 4859 T453 C57 P57664 /update {wt=javabin&version=2} {add=[17 (1420606728769110016)]} 0 0
[junit4:junit4]   2> 4862 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[11 (-1420606728772255744)]} 0 0
[junit4:junit4]   2> 4864 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10017 (1420606728771207168)]} 0 3
[junit4:junit4]   2> 4865 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[11 (-1420606728774352896)]} 0 1
[junit4:junit4]   2> 4866 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10011 (-1420606728776450048)]} 0 0
[junit4:junit4]   2> 4867 T437 C58 P33580 /update {wt=javabin&version=2} {add=[18 (1420606728777498624)]} 0 0
[junit4:junit4]   2> 4868 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10011 (-1420606728778547200)]} 0 0
[junit4:junit4]   2> 4870 T454 C57 P57664 /update {wt=javabin&version=2} {add=[18 (1420606728779595776)]} 0 1
[junit4:junit4]   2> 4871 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10018 (1420606728780644352)]} 0 1
[junit4:junit4]   2> 4872 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[14 (-1420606728782741504)]} 0 0
[junit4:junit4]   2> 4873 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10018 (1420606728783790080)]} 0 0
[junit4:junit4]   2> 4874 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[14 (-1420606728784838656)]} 0 0
[junit4:junit4]   2> 4875 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10014 (-1420606728785887232)]} 0 0
[junit4:junit4]   2> 4877 T437 C58 P33580 /update {wt=javabin&version=2} {add=[19 (1420606728786935808)]} 0 1
[junit4:junit4]   2> 4878 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10014 (-1420606728789032960)]} 0 1
[junit4:junit4]   2> 4880 T455 C57 P57664 /update {wt=javabin&version=2} {add=[19 (1420606728790081536)]} 0 1
[junit4:junit4]   2> 4880 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10019 (1420606728791130112)]} 0 0
[junit4:junit4]   2> 4882 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[15 (-1420606728793227264)]} 0 0
[junit4:junit4]   2> 4883 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10019 (1420606728794275840)]} 0 1
[junit4:junit4]   2> 4884 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[15 (-1420606728795324416)]} 0 0
[junit4:junit4]   2> 4885 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10015 (-1420606728796372992)]} 0 0
[junit4:junit4]   2> 4887 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10015 (-1420606728798470144)]} 0 0
[junit4:junit4]   2> 4890 T437 C58 P33580 /update {wt=javabin&version=2} {add=[20 (1420606728797421568)]} 0 4
[junit4:junit4]   2> 4891 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10020 (1420606728801615872)]} 0 1
[junit4:junit4]   2> 4893 T453 C57 P57664 /update {wt=javabin&version=2} {add=[20 (1420606728803713024)]} 0 1
[junit4:junit4]   2> 4893 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10020 (1420606728804761600)]} 0 0
[junit4:junit4]   2> 4896 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10021 (1420606728807907328)]} 0 1
[junit4:junit4]   2> 4899 T438 C58 P33580 /update {wt=javabin&version=2} {add=[21 (1420606728805810176)]} 0 5
[junit4:junit4]   2> 4900 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10021 (1420606728811053056)]} 0 1
[junit4:junit4]   2> 4902 T453 C57 P57664 /update {wt=javabin&version=2} {add=[21 (1420606728813150208)]} 0 1
[junit4:junit4]   2> 4903 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10017 (-1420606728815247360)]} 0 0
[junit4:junit4]   2> 4904 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[17 (-1420606728816295936)]} 0 0
[junit4:junit4]   2> 4905 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10017 (-1420606728817344512)]} 0 0
[junit4:junit4]   2> 4906 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[17 (-1420606728818393088)]} 0 0
[junit4:junit4]   2> 4908 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10022 (1420606728819441664)]} 0 1
[junit4:junit4]   2> 4909 T438 C58 P33580 /update {wt=javabin&version=2} {add=[22 (1420606728820490240)]} 0 1
[junit4:junit4]   2> 4911 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10022 (1420606728822587392)]} 0 1
[junit4:junit4]   2> 4912 T454 C57 P57664 /update {wt=javabin&version=2} {add=[22 (1420606728823635968)]} 0 1
[junit4:junit4]   2> 4913 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10023 (1420606728825733120)]} 0 0
[junit4:junit4]   2> 4915 T439 C58 P33580 /update {wt=javabin&version=2} {add=[23 (1420606728826781696)]} 0 1
[junit4:junit4]   2> 4916 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10023 (1420606728827830272)]} 0 1
[junit4:junit4]   2> 4917 T453 C57 P57664 /update {wt=javabin&version=2} {add=[23 (1420606728829927424)]} 0 1
[junit4:junit4]   2> 4919 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10024 (1420606728830976000)]} 0 1
[junit4:junit4]   2> 4921 T438 C58 P33580 /update {wt=javabin&version=2} {add=[24 (1420606728833073152)]} 0 1
[junit4:junit4]   2> 4922 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10024 (1420606728834121728)]} 0 1
[junit4:junit4]   2> 4924 T455 C57 P57664 /update {wt=javabin&version=2} {add=[24 (1420606728836218880)]} 0 1
[junit4:junit4]   2> 4924 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10024 (-1420606728837267456)]} 0 0
[junit4:junit4]   2> 4926 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[24 (-1420606728839364608)]} 0 0
[junit4:junit4]   2> 4927 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10024 (-1420606728840413184)]} 0 0
[junit4:junit4]   2> 4929 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[24 (-1420606728842510336)]} 0 1
[junit4:junit4]   2> 4931 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10025 (1420606728843558912)]} 0 1
[junit4:junit4]   2> 4932 T438 C58 P33580 /update {wt=javabin&version=2} {add=[25 (1420606728844607488)]} 0 1
[junit4:junit4]   2> 4942 T453 C57 P57664 /update {wt=javabin&version=2} {add=[25 (1420606728847753217)]} 0 8
[junit4:junit4]   2> 4942 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10025 (1420606728847753216)]} 0 9
[junit4:junit4]   2> 4945 T439 C58 P33580 /update {wt=javabin&version=2} {add=[26 (1420606728858238976)]} 0 1
[junit4:junit4]   2> 4946 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10026 (1420606728858238977)]} 0 2
[junit4:junit4]   2> 4949 T454 C57 P57664 /update {wt=javabin&version=2} {add=[26 (1420606728862433280)]} 0 2
[junit4:junit4]   2> 4949 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10026 (1420606728862433281)]} 0 1
[junit4:junit4]   2> 4952 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10027 (1420606728865579009)]} 0 1
[junit4:junit4]   2> 4955 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10027 (1420606728868724736)]} 0 1
[junit4:junit4]   2> 4958 T436 C58 P33580 /update {wt=javabin&version=2} {add=[27 (1420606728865579008)]} 0 7
[junit4:junit4]   2> 4959 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10028 (1420606728872919040)]} 0 1
[junit4:junit4]   2> 4961 T454 C57 P57664 /update {wt=javabin&version=2} {add=[27 (1420606728875016192)]} 0 1
[junit4:junit4]   2> 4964 T437 C58 P33580 /update {wt=javabin&version=2} {add=[28 (1420606728878161920)]} 0 1
[junit4:junit4]   2> 4964 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10028 (1420606728878161920)]} 0 1
[junit4:junit4]   2> 4967 T455 C57 P57664 /update {wt=javabin&version=2} {add=[28 (1420606728881307648)]} 0 1
[junit4:junit4]   2> 4969 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10029 (1420606728884453376)]} 0 1
[junit4:junit4]   2> 4970 T436 C58 P33580 /update {wt=javabin&version=2} {add=[29 (1420606728884453377)]} 0 1
[junit4:junit4]   2> 4972 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10029 (1420606728887599104)]} 0 1
[junit4:junit4]   2> 4973 T453 C57 P57664 /update {wt=javabin&version=2} {add=[29 (1420606728887599105)]} 0 1
[junit4:junit4]   2> 4976 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10030 (1420606728889696256)]} 0 2
[junit4:junit4]   2> 4977 T437 C58 P33580 /update {wt=javabin&version=2} {add=[30 (1420606728890744832)]} 0 2
[junit4:junit4]   2> 4979 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10030 (1420606728893890560)]} 0 1
[junit4:junit4]   2> 4980 T454 C57 P57664 /update {wt=javabin&version=2} {add=[30 (1420606728894939136)]} 0 1
[junit4:junit4]   2> 4981 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10026 (-1420606728897036288)]} 0 0
[junit4:junit4]   2> 4982 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[26 (-1420606728898084864)]} 0 0
[junit4:junit4]   2> 4984 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10026 (-1420606728900182016)]} 0 1
[junit4:junit4]   2> 4984 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[26 (-1420606728900182017)]} 0 0
[junit4:junit4]   2> 4987 T437 C58 P33580 /update {wt=javabin&version=2} {add=[31 (1420606728902279169)]} 0 1
[junit4:junit4]   2> 4987 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10031 (1420606728902279168)]} 0 1
[junit4:junit4]   2> 4990 T454 C57 P57664 /update {wt=javabin&version=2} {add=[31 (1420606728905424897)]} 0 1
[junit4:junit4]   2> 4991 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10031 (1420606728905424896)]} 0 2
[junit4:junit4]   2> 4992 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4993 T442 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45028_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45028/solr"}
[junit4:junit4]   2> 4995 T438 C58 P33580 /update {wt=javabin&version=2} {add=[32 (1420606728909619200)]} 0 2
[junit4:junit4]   2> 4995 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10032 (1420606728909619201)]} 0 2
[junit4:junit4]   2> 4996 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4996 T471 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4996 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 4996 T441 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 5003 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10032 (1420606728914862080)]} 0 6
[junit4:junit4]   2>  C56_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:45028_solr, base_url=http://127.0.0.1:45028/solr}
[junit4:junit4]   2> 5005 T468 C56 P45028 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2
[junit4:junit4]   2> 5006 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10033 (1420606728923250688)]} 0 1
[junit4:junit4]   2> 5007 T468 C56 P45028 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@26c225 lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c3ff8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5008 T468 C56 P45028 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5009 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 5010 T453 C57 P57664 /update {wt=javabin&version=2} {add=[32 (1420606728914862081)]} 0 13
[junit4:junit4]   2> 5013 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5014 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10033 (1420606728926396416)]} 0 5
[junit4:junit4]   2> 5016 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10028 (-1420606728933736448)]} 0 0
[junit4:junit4]   2> 5018 T439 C58 P33580 /update {wt=javabin&version=2} {add=[33 (1420606728929542144)]} 0 6
[junit4:junit4]   2> 5020 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5021 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10028 (-1420606728935833600)]} 0 3
[junit4:junit4]   2> 5023 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5024 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10034 (1420606728941076480)]} 0 1
[junit4:junit4]   2> 5024 T453 C57 P57664 /update {wt=javabin&version=2} {add=[33 (1420606728937930752)]} 0 4
[junit4:junit4]   2> 5026 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[28 (-1420606728944222208)]} 0 0
[junit4:junit4]   2> 5029 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5030 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10034 (1420606728944222208)]} 0 4
[junit4:junit4]   2> 5030 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5031 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[28 (-1420606728947367936)]} 0 3
[junit4:junit4]   2> 5033 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10035 (1420606728950513664)]} 0 1
[junit4:junit4]   2> 5035 T439 C58 P33580 /update {wt=javabin&version=2} {add=[34 (1420606728953659392)]} 0 0
[junit4:junit4]   2> 5038 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5039 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10035 (1420606728953659392)]} 0 4
[junit4:junit4]   2> 5042 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10036 (1420606728959950848)]} 0 1
[junit4:junit4]   2> 5042 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5043 T455 C57 P57664 /update {wt=javabin&version=2} {add=[34 (1420606728957853696)]} 0 4
[junit4:junit4]   2> 5045 T437 C58 P33580 /update {wt=javabin&version=2} {add=[35 (1420606728964145152)]} 0 0
[junit4:junit4]   2> 5048 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5049 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10036 (1420606728963096576)]} 0 5
[junit4:junit4]   2> 5051 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10033 (-1420606728970436608)]} 0 0
[junit4:junit4]   2> 5052 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5053 T453 C57 P57664 /update {wt=javabin&version=2} {add=[35 (1420606728967290880)]} 0 6
[junit4:junit4]   2> 5055 T439 C58 P33580 /update {wt=javabin&version=2} {add=[36 (1420606728974630912)]} 0 0
[junit4:junit4]   2> 5056 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5056 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10033 (-1420606728973582336)]} 0 3
[junit4:junit4]   2> 5059 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10037 (1420606728978825216)]} 0 0
[junit4:junit4]   2> 5061 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5061 T454 C57 P57664 /update {wt=javabin&version=2} {add=[36 (1420606728977776640)]} 0 3
[junit4:junit4]   2> 5064 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[33 (-1420606728984068096)]} 0 0
[junit4:junit4]   2> 5069 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 5069 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5070 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[33 (-1420606728986165248)]} 0 4
[junit4:junit4]   2> 5070 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10037 (1420606728981970944)]} 0 8
[junit4:junit4]   2> 5073 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10036 (-1420606728993505280)]} 0 1
[junit4:junit4]   2> 5073 T438 C58 P33580 /update {wt=javabin&version=2} {add=[37 (1420606728992456704)]} 0 1
[junit4:junit4]   2> 5078 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5079 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10036 (-1420606728996651008)]} 0 4
[junit4:junit4]   2> 5079 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5080 T455 C57 P57664 /update {wt=javabin&version=2} {add=[37 (1420606728995602432)]} 0 5
[junit4:junit4]   2> 5082 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10038 (1420606729001893888)]} 0 1
[junit4:junit4]   2> 5083 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[36 (-1420606729003991040)]} 0 1
[junit4:junit4]   2> 5087 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5087 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5088 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[36 (-1420606729006088192)]} 0 3
[junit4:junit4]   2> 5088 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10038 (1420606729005039616)]} 0 4
[junit4:junit4]   2> 5090 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10038 (-1420606729011331073)]} 0 0
[junit4:junit4]   2> 5090 T439 C58 P33580 /update {wt=javabin&version=2} {add=[38 (1420606729011331072)]} 0 0
[junit4:junit4]   2> 5097 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5098 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10038 (-1420606729016573952)]} 0 3
[junit4:junit4]   2> 5099 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5099 T454 C57 P57664 /update {wt=javabin&version=2} {add=[38 (1420606729016573953)]} 0 4
[junit4:junit4]   2> 5101 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10039 (1420606729021816832)]} 0 1
[junit4:junit4]   2> 5102 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[38 (-1420606729023913984)]} 0 1
[junit4:junit4]   2> 5106 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5107 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[38 (-1420606729026011137)]} 0 3
[junit4:junit4]   2> 5113 T439 C58 P33580 /update {wt=javabin&version=2} {add=[39 (1420606729031254016)]} 0 4
[junit4:junit4]   2> 5114 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5115 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10039 (1420606729026011136)]} 0 11
[junit4:junit4]   2> 5117 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10039 (-1420606729039642624)]} 0 0
[junit4:junit4]   2> 5118 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5119 T454 C57 P57664 /update {wt=javabin&version=2} {add=[39 (1420606729037545472)]} 0 4
[junit4:junit4]   2> 5121 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[39 (-1420606729043836928)]} 0 0
[junit4:junit4]   2> 5122 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5122 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10039 (-1420606729042788352)]} 0 2
[junit4:junit4]   2> 5125 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5125 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10040 (1420606729048031232)]} 0 1
[junit4:junit4]   2> 5126 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[39 (-1420606729045934080)]} 0 3
[junit4:junit4]   2> 5129 T439 C58 P33580 /update {wt=javabin&version=2} {add=[40 (1420606729051176960)]} 0 1
[junit4:junit4]   2> 5131 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5132 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10040 (1420606729051176960)]} 0 4
[junit4:junit4]   2> 5135 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10041 (1420606729057468416)]} 0 1
[junit4:junit4]   2> 5137 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5138 T455 C57 P57664 /update {wt=javabin&version=2} {add=[40 (1420606729054322688)]} 0 7
[junit4:junit4]   2> 5140 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5141 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10041 (1420606729060614144)]} 0 4
[junit4:junit4]   2> 5141 T437 C58 P33580 /update {wt=javabin&version=2} {add=[41 (1420606729063759872)]} 0 1
[junit4:junit4]   2> 5146 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5146 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10042 (1420606729066905600)]} 0 4
[junit4:junit4]   2> 5147 T454 C57 P57664 /update {wt=javabin&version=2} {add=[41 (1420606729066905600)]} 0 4
[junit4:junit4]   2> 5152 T436 C58 P33580 /update {wt=javabin&version=2} {add=[42 (1420606729075294208)]} 0 1
[junit4:junit4]   2> 5159 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=8 
[junit4:junit4]   2> 5160 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10042 (1420606729072148480)]} 0 12
[junit4:junit4]   2> 5162 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5163 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10043 (1420606729086828544)]} 0 1
[junit4:junit4]   2> 5164 T453 C57 P57664 /update {wt=javabin&version=2} {add=[42 (1420606729078439936)]} 0 10
[junit4:junit4]   2> 5167 T439 C58 P33580 /update {wt=javabin&version=2} {add=[43 (1420606729091022848)]} 0 1
[junit4:junit4]   2> 5169 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5169 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10043 (1420606729091022848)]} 0 4
[junit4:junit4]   2> 5171 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10040 (-1420606729096265728)]} 0 0
[junit4:junit4]   2> 5173 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5174 T455 C57 P57664 /update {wt=javabin&version=2} {add=[43 (1420606729094168576)]} 0 5
[junit4:junit4]   2> 5176 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5176 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10040 (-1420606729098362880)]} 0 3
[junit4:junit4]   2> 5177 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[40 (-1420606729102557184)]} 0 0
[junit4:junit4]   2> 5180 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10044 (1420606729104654336)]} 0 2
[junit4:junit4]   2> 5181 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5182 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[40 (-1420606729104654336)]} 0 3
[junit4:junit4]   2> 5185 T439 C58 P33580 /update {wt=javabin&version=2} {add=[44 (1420606729110945792)]} 0 1
[junit4:junit4]   2> 5188 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5189 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10044 (1420606729110945792)]} 0 4
[junit4:junit4]   2> 5190 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5190 T453 C57 P57664 /update {wt=javabin&version=2} {add=[44 (1420606729114091520)]} 0 3
[junit4:junit4]   2> 5192 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10045 (1420606729117237248)]} 0 1
[junit4:junit4]   2> 5195 T436 C58 P33580 /update {wt=javabin&version=2} {add=[45 (1420606729120382976)]} 0 1
[junit4:junit4]   2> 5199 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5200 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5201 T455 C57 P57664 /update {wt=javabin&version=2} {add=[45 (1420606729123528704)]} 0 4
[junit4:junit4]   2> 5201 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10045 (1420606729120382976)]} 0 7
[junit4:junit4]   2> 5210 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10046 (1420606729135063040)]} 0 2
[junit4:junit4]   2> 5216 T437 C58 P33580 /update {wt=javabin&version=2} {add=[46 (1420606729134014464)]} 0 9
[junit4:junit4]   2> 5221 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5221 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10046 (1420606729141354496)]} 0 7
[junit4:junit4]   2> 5223 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5223 T453 C57 P57664 /update {wt=javabin&version=2} {add=[46 (1420606729146597376)]} 0 4
[junit4:junit4]   2> 5225 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10047 (1420606729151840256)]} 0 1
[junit4:junit4]   2> 5227 T436 C58 P33580 /update {wt=javabin&version=2} {add=[47 (1420606729153937408)]} 0 1
[junit4:junit4]   2> 5234 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 5234 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10047 (1420606729154985984)]} 0 7
[junit4:junit4]   2> 5238 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10048 (1420606729165471744)]} 0 1
[junit4:junit4]   2> 5246 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5246 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10048 (1420606729169666048)]} 0 5
[junit4:junit4]   2> 5250 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10049 (1420606729178054656)]} 0 1
[junit4:junit4]   2> 5251 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5251 T455 C57 P57664 /update {wt=javabin&version=2} {add=[47 (1420606729158131712)]} 0 21
[junit4:junit4]   2> 5254 T438 C58 P33580 /update {wt=javabin&version=2} {add=[48 (1420606729183297536)]} 0 1
[junit4:junit4]   2> 5256 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5257 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10049 (1420606729181200384)]} 0 5
[junit4:junit4]   2> 5260 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10050 (1420606729188540416)]} 0 1
[junit4:junit4]   2> 5263 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5263 T453 C57 P57664 /update {wt=javabin&version=2} {add=[48 (1420606729187491840)]} 0 5
[junit4:junit4]   2> 5267 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5267 T439 C58 P33580 /update {wt=javabin&version=2} {add=[49 (1420606729195880448)]} 0 1
[junit4:junit4]   2> 5267 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10050 (1420606729192734720)]} 0 4
[junit4:junit4]   2> 5271 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10051 (1420606729200074752)]} 0 2
[junit4:junit4]   2> 5273 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5274 T454 C57 P57664 /update {wt=javabin&version=2} {add=[49 (1420606729200074752)]} 0 4
[junit4:junit4]   2> 5277 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5277 T438 C58 P33580 /update {wt=javabin&version=2} {add=[50 (1420606729206366208)]} 0 1
[junit4:junit4]   2> 5277 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10051 (1420606729203220480)]} 0 4
[junit4:junit4]   2> 5279 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10041 (-1420606729209511936)]} 0 0
[junit4:junit4]   2> 5283 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5283 T455 C57 P57664 /update {wt=javabin&version=2} {add=[50 (1420606729209511936)]} 0 4
[junit4:junit4]   2> 5284 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5284 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10041 (-1420606729212657664)]} 0 2
[junit4:junit4]   2> 5287 T439 C58 P33580 /update {wt=javabin&version=2} {add=[51 (1420606729216851968)]} 0 1
[junit4:junit4]   2> 5287 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10052 (1420606729216851969)]} 0 1
[junit4:junit4]   2> 5293 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5294 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10052 (1420606729221046273)]} 0 5
[junit4:junit4]   2> 5297 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 5298 T453 C57 P57664 /update {wt=javabin&version=2} {add=[51 (1420606729221046272)]} 0 9
[junit4:junit4]   2> 5298 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10042 (-1420606729229434880)]} 0 0
[junit4:junit4]   2> 5300 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[41 (-1420606729231532032)]} 0 0
[junit4:junit4]   2> 5303 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5303 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10042 (-1420606729232580608)]} 0 2
[junit4:junit4]   2> 5304 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5305 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[41 (-1420606729233629184)]} 0 3
[junit4:junit4]   2> 5308 T437 C58 P33580 /update {wt=javabin&version=2} {add=[52 (1420606729238872064)]} 0 1
[junit4:junit4]   2> 5312 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10053 (1420606729236774912)]} 0 7
[junit4:junit4]   2> 5316 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5316 T453 C57 P57664 /update {wt=javabin&version=2} {add=[52 (1420606729243066368)]} 0 5
[junit4:junit4]   2> 5318 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5319 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[42 (-1420606729251454976)]} 0 1
[junit4:junit4]   2> 5319 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10053 (1420606729247260672)]} 0 4
[junit4:junit4]   2> 5322 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10054 (1420606729253552128)]} 0 1
[junit4:junit4]   2> 5325 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5327 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[42 (-1420606729255649280)]} 0 6
[junit4:junit4]   2> 5331 T437 C58 P33580 /update {wt=javabin&version=2} {add=[53 (1420606729262989312)]} 0 1
[junit4:junit4]   2> 5335 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5335 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10054 (1420606729257746432)]} 0 10
[junit4:junit4]   2> 5339 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 5339 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10046 (-1420606729272426496)]} 0 0
[junit4:junit4]   2> 5340 T454 C57 P57664 /update {wt=javabin&version=2} {add=[53 (1420606729266135040)]} 0 7
[junit4:junit4]   2> 5343 T438 C58 P33580 /update {wt=javabin&version=2} {add=[54 (1420606729275572224)]} 0 1
[junit4:junit4]   2> 5344 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5344 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10046 (-1420606729275572224)]} 0 2
[junit4:junit4]   2> 5347 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10055 (1420606729279766528)]} 0 1
[junit4:junit4]   2> 5348 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5349 T455 C57 P57664 /update {wt=javabin&version=2} {add=[54 (1420606729278717952)]} 0 4
[junit4:junit4]   2> 5351 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[46 (-1420606729285009408)]} 0 0
[junit4:junit4]   2> 5355 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5355 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 5356 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[46 (-1420606729287106560)]} 0 3
[junit4:junit4]   2> 5356 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10055 (1420606729283960832)]} 0 6
[junit4:junit4]   2> 5359 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10047 (-1420606729293398016)]} 0 0
[junit4:junit4]   2> 5360 T438 C58 P33580 /update {wt=javabin&version=2} {add=[55 (1420606729293398017)]} 0 1
[junit4:junit4]   2> 5364 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5365 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10047 (-1420606729296543744)]} 0 3
[junit4:junit4]   2> 5369 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10056 (1420606729301786624)]} 0 2
[junit4:junit4]   2> 5374 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5375 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5375 T454 C57 P57664 /update {wt=javabin&version=2} {add=[55 (1420606729296543745)]} 0 13
[junit4:junit4]   2> 5376 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10056 (1420606729307029504)]} 0 5
[junit4:junit4]   2> 5377 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[47 (-1420606729312272384)]} 0 0
[junit4:junit4]   2> 5379 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10057 (1420606729313320960)]} 0 1
[junit4:junit4]   2> 5382 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5382 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[47 (-1420606729315418112)]} 0 2
[junit4:junit4]   2> 5385 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5385 T438 C58 P33580 /update {wt=javabin&version=2} {add=[56 (1420606729319612416)]} 0 1
[junit4:junit4]   2> 5385 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10057 (1420606729316466688)]} 0 4
[junit4:junit4]   2> 5387 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10048 (-1420606729322758144)]} 0 0
[junit4:junit4]   2> 5391 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5392 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10048 (-1420606729325903872)]} 0 3
[junit4:junit4]   2> 5393 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 5394 T453 C57 P57664 /update {wt=javabin&version=2} {add=[56 (1420606729322758144)]} 0 7
[junit4:junit4]   2> 5395 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10058 (1420606729330098176)]} 0 1
[junit4:junit4]   2> 5399 T439 C58 P33580 /update {wt=javabin&version=2} {add=[57 (1420606729334292480)]} 0 2
[junit4:junit4]   2> 5401 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5402 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10058 (1420606729334292480)]} 0 5
[junit4:junit4]   2> 5404 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5405 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10059 (1420606729340583936)]} 0 1
[junit4:junit4]   2> 5405 T455 C57 P57664 /update {wt=javabin&version=2} {add=[57 (1420606729337438208)]} 0 4
[junit4:junit4]   2> 5408 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[48 (-1420606729344778240)]} 0 1
[junit4:junit4]   2> 5410 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5411 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10059 (1420606729343729664)]} 0 4
[junit4:junit4]   2> 5412 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5412 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[48 (-1420606729346875392)]} 0 2
[junit4:junit4]   2> 5413 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10050 (-1420606729350021120)]} 0 0
[junit4:junit4]   2> 5416 T439 C58 P33580 /update {wt=javabin&version=2} {add=[58 (1420606729352118272)]} 0 1
[junit4:junit4]   2> 5419 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5420 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10050 (-1420606729353166848)]} 0 4
[junit4:junit4]   2> 5423 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10060 (1420606729359458304)]} 0 1
[junit4:junit4]   2> 5423 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5424 T453 C57 P57664 /update {wt=javabin&version=2} {add=[58 (1420606729357361152)]} 0 6
[junit4:junit4]   2> 5430 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5431 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10060 (1420606729362604032)]} 0 6
[junit4:junit4]   2> 5431 T436 C58 P33580 /update {wt=javabin&version=2} {add=[59 (1420606729363652608)]} 0 5
[junit4:junit4]   2> 5433 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10051 (-1420606729370992640)]} 0 0
[junit4:junit4]   2> 5437 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5437 T455 C57 P57664 /update {wt=javabin&version=2} {add=[59 (1420606729372041216)]} 0 4
[junit4:junit4]   2> 5438 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5439 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10051 (-1420606729374138368)]} 0 3
[junit4:junit4]   2> 5440 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[50 (-1420606729378332672)]} 0 1
[junit4:junit4]   2> 5445 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5446 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[50 (-1420606729381478400)]} 0 3
[junit4:junit4]   2> 5447 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10061 (1420606729379381248)]} 0 6
[junit4:junit4]   2> 5449 T436 C58 P33580 /update {wt=javabin&version=2} {add=[60 (1420606729386721280)]} 0 1
[junit4:junit4]   2> 5452 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5453 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10061 (1420606729387769856)]} 0 4
[junit4:junit4]   2> 5454 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5454 T453 C57 P57664 /update {wt=javabin&version=2} {add=[60 (1420606729389867008)]} 0 3
[junit4:junit4]   2> 5455 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10062 (1420606729394061312)]} 0 0
[junit4:junit4]   2> 5456 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[51 (-1420606729395109888)]} 0 0
[junit4:junit4]   2> 5460 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5461 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5461 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[51 (-1420606729397207041)]} 0 3
[junit4:junit4]   2> 5461 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10062 (1420606729397207040)]} 0 4
[junit4:junit4]   2> 5465 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10063 (1420606729403498496)]} 0 1
[junit4:junit4]   2> 5466 T438 C58 P33580 /update {wt=javabin&version=2} {add=[61 (1420606729402449920)]} 0 3
[junit4:junit4]   2> 5471 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5472 T455 C57 P57664 /update {wt=javabin&version=2} {add=[61 (1420606729407692801)]} 0 4
[junit4:junit4]   2> 5474 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 5475 T437 C58 P33580 /update {wt=javabin&version=2} {add=[62 (1420606729413984256)]} 0 1
[junit4:junit4]   2> 5475 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10063 (1420606729407692800)]} 0 7
[junit4:junit4]   2> 5478 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10064 (1420606729417129984)]} 0 1
[junit4:junit4]   2> 5480 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5481 T454 C57 P57664 /update {wt=javabin&version=2} {add=[62 (1420606729417129984)]} 0 4
[junit4:junit4]   2> 5484 T436 C58 P33580 /update {wt=javabin&version=2} {add=[63 (1420606729423421440)]} 0 1
[junit4:junit4]   2> 5490 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5491 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10064 (1420606729420275712)]} 0 11
[junit4:junit4]   2> 5493 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5493 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10065 (1420606729433907200)]} 0 0
[junit4:junit4]   2> 5494 T453 C57 P57664 /update {wt=javabin&version=2} {add=[63 (1420606729426567168)]} 0 8
[junit4:junit4]   2> 5496 T437 C58 P33580 /update {wt=javabin&version=2} {add=[64 (1420606729437052928)]} 0 0
[junit4:junit4]   2> 5499 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5500 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10065 (1420606729437052928)]} 0 5
[junit4:junit4]   2> 5502 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10052 (-1420606729443344384)]} 0 1
[junit4:junit4]   2> 5502 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5502 T453 C57 P57664 /update {wt=javabin&version=2} {add=[64 (1420606729440198656)]} 0 4
[junit4:junit4]   2> 5505 T436 C58 P33580 /update {wt=javabin&version=2} {add=[65 (1420606729446490112)]} 0 1
[junit4:junit4]   2> 5507 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5508 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10052 (-1420606729445441536)]} 0 4
[junit4:junit4]   2> 5511 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5511 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10066 (1420606729451732992)]} 0 1
[junit4:junit4]   2> 5512 T455 C57 P57664 /update {wt=javabin&version=2} {add=[65 (1420606729448587264)]} 0 5
[junit4:junit4]   2> 5515 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[52 (-1420606729456975872)]} 0 0
[junit4:junit4]   2> 5517 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5517 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10066 (1420606729455927296)]} 0 4
[junit4:junit4]   2> 5518 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5519 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[52 (-1420606729459073024)]} 0 2
[junit4:junit4]   2> 5521 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10067 (1420606729462218752)]} 0 1
[junit4:junit4]   2> 5527 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5527 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10067 (1420606729465364480)]} 0 4
[junit4:junit4]   2> 5529 T436 C58 P33580 /update {wt=javabin&version=2} {add=[66 (1420606729464315904)]} 0 8
[junit4:junit4]   2> 5530 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10056 (-1420606729472704512)]} 0 0
[junit4:junit4]   2> 5534 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5534 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10056 (-1420606729474801664)]} 0 2
[junit4:junit4]   2> 5538 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10068 (1420606729480044544)]} 0 1
[junit4:junit4]   2> 5544 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5545 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10068 (1420606729483190272)]} 0 5
[junit4:junit4]   2> 5545 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 5545 T453 C57 P57664 /update {wt=javabin&version=2} {add=[66 (1420606729473753088)]} 0 14
[junit4:junit4]   2> 5547 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10057 (-1420606729490530304)]} 0 0
[junit4:junit4]   2> 5548 T437 C58 P33580 /update {wt=javabin&version=2} {add=[67 (1420606729491578880)]} 0 0
[junit4:junit4]   2> 5551 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5552 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10057 (-1420606729492627456)]} 0 3
[junit4:junit4]   2> 5554 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5554 T453 C57 P57664 /update {wt=javabin&version=2} {add=[67 (1420606729494724608)]} 0 4
[junit4:junit4]   2> 5555 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10069 (1420606729497870336)]} 0 1
[junit4:junit4]   2> 5557 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[56 (-1420606729501016064)]} 0 0
[junit4:junit4]   2> 5560 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5561 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5561 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10069 (1420606729501016064)]} 0 4
[junit4:junit4]   2> 5561 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[56 (-1420606729503113216)]} 0 2
[junit4:junit4]   2> 5563 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10061 (-1420606729507307520)]} 0 0
[junit4:junit4]   2> 5564 T437 C58 P33580 /update {wt=javabin&version=2} {add=[68 (1420606729507307521)]} 0 1
[junit4:junit4]   2> 5567 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5568 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10061 (-1420606729509404672)]} 0 3
[junit4:junit4]   2> 5569 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5570 T455 C57 P57664 /update {wt=javabin&version=2} {add=[68 (1420606729510453248)]} 0 4
[junit4:junit4]   2> 5571 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10070 (1420606729514647552)]} 0 1
[junit4:junit4]   2> 5572 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[57 (-1420606729516744704)]} 0 0
[junit4:junit4]   2> 5576 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5576 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5577 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[57 (-1420606729518841856)]} 0 3
[junit4:junit4]   2> 5577 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10070 (1420606729517793280)]} 0 4
[junit4:junit4]   2> 5579 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10063 (-1420606729524084736)]} 0 0
[junit4:junit4]   2> 5579 T437 C58 P33580 /update {wt=javabin&version=2} {add=[69 (1420606729524084737)]} 0 0
[junit4:junit4]   2> 5583 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5583 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10063 (-1420606729526181888)]} 0 2
[junit4:junit4]   2> 5584 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5585 T454 C57 P57664 /update {wt=javabin&version=2} {add=[69 (1420606729526181889)]} 0 4
[junit4:junit4]   2> 5586 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10071 (1420606729531424768)]} 0 1
[junit4:junit4]   2> 5587 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[61 (-1420606729531424769)]} 0 1
[junit4:junit4]   2> 5591 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5591 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5592 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10071 (1420606729533521920)]} 0 4
[junit4:junit4]   2> 5592 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[61 (-1420606729534570496)]} 0 3
[junit4:junit4]   2> 5594 T437 C58 P33580 /update {wt=javabin&version=2} {add=[70 (1420606729539813377)]} 0 0
[junit4:junit4]   2> 5595 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10072 (1420606729539813376)]} 0 1
[junit4:junit4]   2> 5608 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5608 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5608 T454 C57 P57664 /update {wt=javabin&version=2} {add=[70 (1420606729542959104)]} 0 12
[junit4:junit4]   2> 5609 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10072 (1420606729542959105)]} 0 12
[junit4:junit4]   2> 5611 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[63 (-1420606729557639168)]} 0 1
[junit4:junit4]   2> 5611 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10073 (1420606729557639169)]} 0 0
[junit4:junit4]   2> 5614 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5615 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[63 (-1420606729559736320)]} 0 2
[junit4:junit4]   2> 5618 T437 C58 P33580 /update {wt=javabin&version=2} {add=[71 (1420606729563930624)]} 0 1
[junit4:junit4]   2> 5618 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 5619 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10073 (1420606729559736321)]} 0 6
[junit4:junit4]   2> 5622 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10074 (1420606729568124928)]} 0 1
[junit4:junit4]   2> 5676 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=52 
[junit4:junit4]   2> 5676 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=50 
[junit4:junit4]   2> 5677 T455 C57 P57664 /update {wt=javabin&version=2} {add=[71 (1420606729567076352)]} 0 57
[junit4:junit4]   2> 5677 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10074 (1420606729571270656)]} 0 53
[junit4:junit4]   2> 5679 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10064 (-1420606729628942337)]} 0 0
[junit4:junit4]   2> 5680 T436 C58 P33580 /update {wt=javabin&version=2} {add=[72 (1420606729628942336)]} 0 1
[junit4:junit4]   2> 5685 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5685 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10064 (-1420606729633136640)]} 0 2
[junit4:junit4]   2> 5685 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5686 T455 C57 P57664 /update {wt=javabin&version=2} {add=[72 (1420606729632088064)]} 0 4
[junit4:junit4]   2> 5689 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10075 (1420606729638379520)]} 0 1
[junit4:junit4]   2> 5694 T439 C58 P33580 /update {wt=javabin&version=2} {add=[73 (1420606729639428096)]} 0 5
[junit4:junit4]   2> 5695 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5695 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10075 (1420606729641525248)]} 0 4
[junit4:junit4]   2> 5697 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10076 (1420606729647816704)]} 0 0
[junit4:junit4]   2> 5701 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5702 T455 C57 P57664 /update {wt=javabin&version=2} {add=[73 (1420606729646768128)]} 0 6
[junit4:junit4]   2> 5703 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5703 T456 C57 P57664 /update {wt=javabin&version=2} {add=[10076 (1420606729650962432)]} 0 4
[junit4:junit4]   2> 5705 T436 C58 P33580 /update {wt=javabin&version=2} {add=[74 (1420606729655156736)]} 0 1
[junit4:junit4]   2> 5705 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10065 (-1420606729656205312)]} 0 0
[junit4:junit4]   2> 5711 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5712 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5712 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10065 (-1420606729658302465)]} 0 5
[junit4:junit4]   2> 5713 T453 C57 P57664 /update {wt=javabin&version=2} {add=[74 (1420606729658302464)]} 0 6
[junit4:junit4]   2> 5715 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[64 (-1420606729666691072)]} 0 0
[junit4:junit4]   2> 5715 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10077 (1420606729665642496)]} 0 1
[junit4:junit4]   2> 5719 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5720 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[64 (-1420606729668788224)]} 0 3
[junit4:junit4]   2> 5721 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5722 T456 C57 P57664 /update {wt=javabin&version=2} {add=[10077 (1420606729669836800)]} 0 4
[junit4:junit4]   2> 5723 T436 C58 P33580 /update {wt=javabin&version=2} {add=[75 (1420606729675079680)]} 0 0
[junit4:junit4]   2> 5725 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10078 (1420606729676128256)]} 0 1
[junit4:junit4]   2> 5730 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5730 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10078 (1420606729679273984)]} 0 3
[junit4:junit4]   2> 5733 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10066 (-1420606729685565440)]} 0 1
[junit4:junit4]   2> 5737 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5737 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=7 
[junit4:junit4]   2> 5738 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10066 (-1420606729687662592)]} 0 3
[junit4:junit4]   2> 5738 T454 C57 P57664 /update {wt=javabin&version=2} {add=[75 (1420606729678225408)]} 0 13
[junit4:junit4]   2> 5743 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10079 (1420606729696051200)]} 0 0
[junit4:junit4]   2> 5744 T436 C58 P33580 /update {wt=javabin&version=2} {add=[76 (1420606729696051201)]} 0 1
[junit4:junit4]   2> 5749 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5750 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5750 T456 C57 P57664 /update {wt=javabin&version=2} {add=[10079 (1420606729699196928)]} 0 4
[junit4:junit4]   2> 5751 T453 C57 P57664 /update {wt=javabin&version=2} {add=[76 (1420606729700245504)]} 0 4
[junit4:junit4]   2> 5753 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[65 (-1420606729706536960)]} 0 0
[junit4:junit4]   2> 5753 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10080 (1420606729705488384)]} 0 1
[junit4:junit4]   2> 5757 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5758 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[65 (-1420606729708634112)]} 0 3
[junit4:junit4]   2> 5758 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5759 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10080 (1420606729708634113)]} 0 4
[junit4:junit4]   2> 5761 T439 C58 P33580 /update {wt=javabin&version=2} {add=[77 (1420606729713876992)]} 0 1
[junit4:junit4]   2> 5762 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10081 (1420606729714925568)]} 0 1
[junit4:junit4]   2> 5767 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5768 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10081 (1420606729718071296)]} 0 4
[junit4:junit4]   2> 5776 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10082 (1420606729724362752)]} 0 6
[junit4:junit4]   2> 5776 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5777 T456 C57 P57664 /update {wt=javabin&version=2} {add=[77 (1420606729717022720)]} 0 14
[junit4:junit4]   2> 5781 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5782 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10082 (1420606729732751360)]} 0 4
[junit4:junit4]   2> 5784 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10067 (-1420606729739042816)]} 0 0
[junit4:junit4]   2> 5790 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5790 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10067 (-1420606729742188544)]} 0 3
[junit4:junit4]   2> 5838 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10083 (1420606729748480000)]} 0 45
[junit4:junit4]   2> 5840 T437 C58 P33580 /update {wt=javabin&version=2} {add=[78 (1420606729733799936)]} 0 61
[junit4:junit4]   2> 5850 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5851 T456 C57 P57664 /update {wt=javabin&version=2} {add=[78 (1420606729799860224)]} 0 9
[junit4:junit4]   2> 5852 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 5852 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10083 (1420606729798811648)]} 0 12
[junit4:junit4]   2> 5854 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[66 (-1420606729812443136)]} 0 0
[junit4:junit4]   2> 5855 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10084 (1420606729812443137)]} 0 1
[junit4:junit4]   2> 5858 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5858 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[66 (-1420606729814540288)]} 0 2
[junit4:junit4]   2> 5861 T436 C58 P33580 /update {wt=javabin&version=2} {add=[79 (1420606729818734592)]} 0 1
[junit4:junit4]   2> 5902 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5903 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10084 (1420606729815588864)]} 0 46
[junit4:junit4]   2> 5905 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10070 (-1420606729865920512)]} 0 0
[junit4:junit4]   2> 5905 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 5906 T456 C57 P57664 /update {wt=javabin&version=2} {add=[79 (1420606729821880320)]} 0 43
[junit4:junit4]   2> 5909 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5910 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10070 (-1420606729868017664)]} 0 3
[junit4:junit4]   2> 5910 T438 C58 P33580 /update {wt=javabin&version=2} {add=[80 (1420606729869066240)]} 0 2
[junit4:junit4]   2> 5913 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10085 (1420606729873260544)]} 0 1
[junit4:junit4]   2> 5917 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 5918 T454 C57 P57664 /update {wt=javabin&version=2} {add=[80 (1420606729873260544)]} 0 6
[junit4:junit4]   2> 5921 T436 C58 P33580 /update {wt=javabin&version=2} {add=[81 (1420606729881649152)]} 0 1
[junit4:junit4]   2> 5927 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5928 T456 C57 P57664 /update {wt=javabin&version=2} {add=[81 (1420606729885843456)]} 0 4
[junit4:junit4]   2> 5931 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5931 T437 C58 P33580 /update {wt=javabin&version=2} {add=[82 (1420606729892134912)]} 0 1
[junit4:junit4]   2> 5931 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10085 (1420606729878503424)]} 0 14
[junit4:junit4]   2> 5935 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10086 (1420606729896329216)]} 0 2
[junit4:junit4]   2> 5936 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5937 T455 C57 P57664 /update {wt=javabin&version=2} {add=[82 (1420606729895280640)]} 0 4
[junit4:junit4]   2> 5939 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[67 (-1420606729901572096)]} 0 0
[junit4:junit4]   2> 5940 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5941 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10086 (1420606729899474944)]} 0 4
[junit4:junit4]   2> 5944 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10087 (1420606729905766400)]} 0 1
[junit4:junit4]   2> 5945 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5945 T456 C57 P57664 /update {wt=javabin&version=2} {delete=[67 (-1420606729905766400)]} 0 2
[junit4:junit4]   2> 5948 T437 C58 P33580 /update {wt=javabin&version=2} {add=[83 (1420606729909960704)]} 0 1
[junit4:junit4]   2> 5950 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5951 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10087 (1420606729909960704)]} 0 4
[junit4:junit4]   2> 5952 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5953 T455 C57 P57664 /update {wt=javabin&version=2} {add=[83 (1420606729913106432)]} 0 4
[junit4:junit4]   2> 5953 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10088 (1420606729916252160)]} 0 0
[junit4:junit4]   2> 5962 T436 C58 P33580 /update {wt=javabin&version=2} {add=[84 (1420606729918349312)]} 0 7
[junit4:junit4]   2> 5966 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5966 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10088 (1420606729918349312)]} 0 11
[junit4:junit4]   2> 5967 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5968 T456 C57 P57664 /update {wt=javabin&version=2} {add=[84 (1420606729927786496)]} 0 4
[junit4:junit4]   2> 5968 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10071 (-1420606729931980800)]} 0 0
[junit4:junit4]   2> 5970 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[70 (-1420606729934077952)]} 0 0
[junit4:junit4]   2> 5972 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5973 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10071 (-1420606729934077952)]} 0 3
[junit4:junit4]   2> 5974 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5975 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[70 (-1420606729937223680)]} 0 2
[junit4:junit4]   2> 5976 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10089 (1420606729939320832)]} 0 1
[junit4:junit4]   2> 5978 T436 C58 P33580 /update {wt=javabin&version=2} {add=[85 (1420606729941417984)]} 0 1
[junit4:junit4]   2> 5984 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5985 T456 C57 P57664 /update {wt=javabin&version=2} {add=[85 (1420606729944563712)]} 0 5
[junit4:junit4]   2> 5987 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 5988 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10089 (1420606729942466560)]} 0 10
[junit4:junit4]   2> 5988 T438 C58 P33580 /update {wt=javabin&version=2} {add=[86 (1420606729951903744)]} 0 1
[junit4:junit4]   2> 5990 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[10072 (-1420606729955049472)]} 0 0
[junit4:junit4]   2> 5993 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 5993 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 5994 T453 C57 P57664 /update {wt=javabin&version=2} {add=[86 (1420606729955049472)]} 0 4
[junit4:junit4]   2> 5994 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10072 (-1420606729957146624)]} 0 2
[junit4:junit4]   2> 5997 T437 C58 P33580 /update {wt=javabin&version=2} {add=[87 (1420606729961340928)]} 0 1
[junit4:junit4]   2> 5997 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10090 (1420606729961340929)]} 0 1
[junit4:junit4]   2> 6002 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6003 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6003 T456 C57 P57664 /update {wt=javabin&version=2} {add=[87 (1420606729964486656)]} 0 4
[junit4:junit4]   2> 6004 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10090 (1420606729964486657)]} 0 5
[junit4:junit4]   2> 6006 T438 C58 P33580 /update {wt=javabin&version=2} {add=[88 (1420606729970778112)]} 0 1
[junit4:junit4]   2> 6008 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10091 (1420606729972875264)]} 0 1
[junit4:junit4]   2> 6011 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6012 T455 C57 P57664 /update {wt=javabin&version=2} {add=[88 (1420606729973923840)]} 0 4
[junit4:junit4]   2> 6013 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6014 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10091 (1420606729976020992)]} 0 4
[junit4:junit4]   2> 6014 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[71 (-1420606729980215296)]} 0 0
[junit4:junit4]   2> 6016 T436 C58 P33580 /update {wt=javabin&version=2} {delete=[10077 (-1420606729982312448)]} 0 0
[junit4:junit4]   2> 6018 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6018 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[71 (-1420606729982312448)]} 0 2
[junit4:junit4]   2> 6020 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6020 T456 C57 P57664 /update {wt=javabin&version=2} {delete=[10077 (-1420606729984409600)]} 0 2
[junit4:junit4]   2> 6021 T438 C58 P33580 /update {wt=javabin&version=2} {add=[89 (1420606729986506752)]} 0 1
[junit4:junit4]   2> 6023 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10092 (1420606729988603904)]} 0 1
[junit4:junit4]   2> 6026 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6026 T455 C57 P57664 /update {wt=javabin&version=2} {add=[89 (1420606729989652480)]} 0 3
[junit4:junit4]   2> 6028 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6029 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[72 (-1420606729994895360)]} 0 1
[junit4:junit4]   2> 6029 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10092 (1420606729991749632)]} 0 4
[junit4:junit4]   2> 6031 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10093 (1420606729998041088)]} 0 0
[junit4:junit4]   2> 6033 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6033 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[72 (-1420606729998041088)]} 0 2
[junit4:junit4]   2> 6036 T438 C58 P33580 /update {wt=javabin&version=2} {add=[90 (1420606730002235392)]} 0 1
[junit4:junit4]   2> 6036 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6037 T456 C57 P57664 /update {wt=javabin&version=2} {add=[10093 (1420606730000138240)]} 0 4
[junit4:junit4]   2> 6040 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10094 (1420606730006429696)]} 0 1
[junit4:junit4]   2> 6046 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 6047 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10094 (1420606730009575424)]} 0 5
[junit4:junit4]   2> 6047 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 6048 T455 C57 P57664 /update {wt=javabin&version=2} {add=[90 (1420606730005381120)]} 0 10
[junit4:junit4]   2> 6050 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10095 (1420606730016915456)]} 0 1
[junit4:junit4]   2> 6057 T436 C58 P33580 /update {wt=javabin&version=2} {add=[91 (1420606730017964032)]} 0 7
[junit4:junit4]   2> 6061 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6062 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10095 (1420606730020061184)]} 0 10
[junit4:junit4]   2> 6062 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6063 T456 C57 P57664 /update {wt=javabin&version=2} {add=[91 (1420606730027401216)]} 0 4
[junit4:junit4]   2> 6064 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10078 (-1420606730032644096)]} 0 0
[junit4:junit4]   2> 6065 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[77 (-1420606730033692672)]} 0 0
[junit4:junit4]   2> 6068 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6068 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10078 (-1420606730034741248)]} 0 2
[junit4:junit4]   2> 6069 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6069 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[77 (-1420606730035789824)]} 0 2
[junit4:junit4]   2> 6071 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10096 (1420606730038935552)]} 0 1
[junit4:junit4]   2> 6072 T436 C58 P33580 /update {wt=javabin&version=2} {add=[92 (1420606730039984128)]} 0 1
[junit4:junit4]   2> 6076 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6076 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10096 (1420606730042081280)]} 0 3
[junit4:junit4]   2> 6077 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6078 T456 C57 P57664 /update {wt=javabin&version=2} {add=[92 (1420606730043129856)]} 0 4
[junit4:junit4]   2> 6078 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10088 (-1420606730047324160)]} 0 0
[junit4:junit4]   2> 6080 T439 C58 P33580 /update {wt=javabin&version=2} {add=[93 (1420606730048372736)]} 0 1
[junit4:junit4]   2> 6082 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6082 T453 C57 P57664 /update {wt=javabin&version=2} {delete=[10088 (-1420606730049421312)]} 0 2
[junit4:junit4]   2> 6085 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6085 T455 C57 P57664 /update {wt=javabin&version=2} {add=[93 (1420606730051518464)]} 0 3
[junit4:junit4]   2> 6085 T437 C58 P33580 /update {wt=javabin&version=2} {add=[10097 (1420606730053615616)]} 0 1
[junit4:junit4]   2> 6088 T436 C58 P33580 /update {wt=javabin&version=2} {add=[94 (1420606730056761344)]} 0 1
[junit4:junit4]   2> 6090 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6091 T454 C57 P57664 /update {wt=javabin&version=2} {add=[10097 (1420606730056761344)]} 0 4
[junit4:junit4]   2> 6093 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6093 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10098 (1420606730063052800)]} 0 0
[junit4:junit4]   2> 6093 T456 C57 P57664 /update {wt=javabin&version=2} {add=[94 (1420606730059907072)]} 0 3
[junit4:junit4]   2> 6096 T439 C58 P33580 /update {wt=javabin&version=2} {add=[95 (1420606730065149952)]} 0 1
[junit4:junit4]   2> 6098 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6098 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10098 (1420606730065149952)]} 0 3
[junit4:junit4]   2> 6101 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10089 (-1420606730070392832)]} 0 1
[junit4:junit4]   2> 6104 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6105 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10089 (-1420606730072489984)]} 0 3
[junit4:junit4]   2> 6106 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 6106 T455 C57 P57664 /update {wt=javabin&version=2} {add=[95 (1420606730068295680)]} 0 8
[junit4:junit4]   2> 6108 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[78 (-1420606730078781440)]} 0 0
[junit4:junit4]   2> 6108 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10099 (1420606730077732864)]} 0 1
[junit4:junit4]   2> 6113 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6113 T456 C57 P57664 /update {wt=javabin&version=2} {delete=[78 (-1420606730081927168)]} 0 3
[junit4:junit4]   2> 6115 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6116 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10099 (1420606730081927169)]} 0 5
[junit4:junit4]   2> 6117 T439 C58 P33580 /update {wt=javabin&version=2} {add=[96 (1420606730087170048)]} 0 1
[junit4:junit4]   2> 6118 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10090 (-1420606730089267200)]} 0 0
[junit4:junit4]   2> 6123 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6124 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6124 T454 C57 P57664 /update {wt=javabin&version=2} {add=[96 (1420606730090315776)]} 0 5
[junit4:junit4]   2> 6125 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[10090 (-1420606730092412928)]} 0 4
[junit4:junit4]   2> 6127 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[88 (-1420606730098704384)]} 0 1
[junit4:junit4]   2> 6128 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10100 (1420606730098704385)]} 0 1
[junit4:junit4]   2> 6131 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6132 T456 C57 P57664 /update {wt=javabin&version=2} {delete=[88 (-1420606730100801536)]} 0 3
[junit4:junit4]   2> 6134 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6134 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10100 (1420606730101850112)]} 0 4
[junit4:junit4]   2> 6137 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10091 (-1420606730109190144)]} 0 0
[junit4:junit4]   2> 6141 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6142 T439 C58 P33580 /update {wt=javabin&version=2} {add=[97 (1420606730106044416)]} 0 8
[junit4:junit4]   2> 6142 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10091 (-1420606730111287296)]} 0 3
[junit4:junit4]   2> 6145 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10101 (1420606730116530176)]} 0 1
[junit4:junit4]   2> 6147 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6148 T455 C57 P57664 /update {wt=javabin&version=2} {add=[97 (1420606730116530176)]} 0 4
[junit4:junit4]   2> 6151 T436 C58 P33580 /update {wt=javabin&version=2} {add=[98 (1420606730122821632)]} 0 1
[junit4:junit4]   2> 6157 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6157 T453 C57 P57664 /update {wt=javabin&version=2} {add=[98 (1420606730127015936)]} 0 3
[junit4:junit4]   2> 6158 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6158 T456 C57 P57664 /update {wt=javabin&version=2} {add=[10101 (1420606730119675904)]} 0 11
[junit4:junit4]   2> 6159 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[89 (-1420606730132258816)]} 0 0
[junit4:junit4]   2> 6161 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10102 (1420606730133307392)]} 0 1
[junit4:junit4]   2> 6163 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6164 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[89 (-1420606730134355968)]} 0 3
[junit4:junit4]   2> 6165 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6166 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10102 (1420606730136453120)]} 0 4
[junit4:junit4]   2> 6166 T438 C58 P33580 /update {wt=javabin&version=2} {add=[99 (1420606730138550272)]} 0 1
[junit4:junit4]   2> 6168 T436 C58 P33580 /update {wt=javabin&version=2} {add=[10103 (1420606730141696000)]} 0 0
[junit4:junit4]   2> 6174 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6174 T456 C57 P57664 /update {wt=javabin&version=2} {add=[10103 (1420606730143793152)]} 0 4
[junit4:junit4]   2> 6176 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6176 T453 C57 P57664 /update {wt=javabin&version=2} {add=[99 (1420606730141696000)]} 0 8
[junit4:junit4]   2> 6177 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[10092 (-1420606730150084608)]} 0 1
[junit4:junit4]   2> 6178 T439 C58 P33580 /update {wt=javabin&version=2} {delete=[90 (-1420606730152181760)]} 0 0
[junit4:junit4]   2> 6180 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 6181 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[10092 (-1420606730152181760)]} 0 3
[junit4:junit4]   2> 6182 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6182 T455 C57 P57664 /update {wt=javabin&version=2} {delete=[90 (-1420606730154278912)]} 0 2
[junit4:junit4]   2> 6185 T436 C58 P33580 /update {wt=javabin&version=2} {add=[100 (1420606730158473216)]} 0 1
[junit4:junit4]   2> 6189 T438 C58 P33580 /update {wt=javabin&version=2} {add=[10104 (1420606730157424640)]} 0 6
[junit4:junit4]   2> 6194 T467 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 6194 T468 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6195 T456 C57 P57664 /update {wt=javabin&version=2} {add=[100 (1420606730161618944)]} 0 8
[junit4:junit4]   2> 6195 T453 C57 P57664 /update {wt=javabin&version=2} {add=[10104 (1420606730165813248)]} 0 4
[junit4:junit4]   2> 6197 T437 C58 P33580 /update {wt=javabin&version=2} {delete=[91 (-1420606730172104704)]} 0 0
[junit4:junit4]   2> 6198 T439 C58 P33580 /update {wt=javabin&version=2} {add=[10105 (1420606730172104705)]} 0 1
[junit4:junit4]   2> 6201 T469 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6201 T454 C57 P57664 /update {wt=javabin&version=2} {delete=[91 (-1420606730174201856)]} 0 2
[junit4:junit4]   2> 6203 T466 C56 P45028 REQ /update {distrib.from=http://127.0.0.1:57664/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 6203 T455 C57 P57664 /update {wt=javabin&version=2} {add=[10105 (1420606730175250432)]} 0 3
[junit4:junit4]   2> 6203 T436 C58 P33580 /update {wt=javabin&version=2} {add=[101 (1420606730178396160)]} 0 0
[junit4:junit4]   2> 6205 T438 C58 P33580 /update {wt=javabin&version=2} {delete=[10094 (-1420606730180493312)]} 0 0
[junit4:junit4]   2> 6208 T

[...truncated too long message...]

n=collection1, node_name=127.0.0.1:45028_solr, base_url=http://127.0.0.1:45028/solr, leader=true}
[junit4:junit4]   2> 29171 T421 C59 P45028 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/index.20121206081611659
[junit4:junit4]   2> 29172 T421 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 29225 T421 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.RecoveryZkTest-1354796146085/jetty2/index.20121206081611659
[junit4:junit4]   2> 29226 T618 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88787920230088710-127.0.0.1:45028_solr-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 29226 T426 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b70249da90006
[junit4:junit4]   2> 29227 T423 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47246 which had sessionid 0x13b70249da90006
[junit4:junit4]   2> 29228 T447 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 29228 T421 oaz.ZooKeeper.close Session: 0x13b70249da90006 closed
[junit4:junit4]   2> 29228 T447 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 29250 T421 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 29302 T426 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13b70249da90003
[junit4:junit4]   2> 29303 T447 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 29303 T423 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47231 which had sessionid 0x13b70249da90003
[junit4:junit4]   2> 29303 T421 oaz.ZooKeeper.close Session: 0x13b70249da90003 closed
[junit4:junit4]   2> 29304 T421 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 29304 T421 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 29304 T421 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 29305 T426 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 29305 T421 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 29305 T425 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 29305 T421 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 29306 T421 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:34320 34320
[junit4:junit4]   2> 29307 T423 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 29307 T421 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 29308 T421 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 29308 T421 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 29308 T421 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 29308 T421 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 29309 T421 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33580
[junit4:junit4]   2> 29320 T421 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 29322 T421 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 29358 T420 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4:junit4]   2> 29918 T424 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 29984 T458 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 29984 T458 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 29984 T458 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 29984 T458 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 30227 T566 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 30228 T566 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 30228 T566 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 30228 T566 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=ar_YE, timezone=America/Glace_Bay
[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Oracle Corporation 1.7.0_09 (32-bit)/cpus=8,threads=3,free=140458432,total=248184832
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestAnalyzedSuggestions, PeerSyncTest, OutputWriterTest, DistributedQueryElevationComponentTest, XmlUpdateRequestHandlerTest, TimeZoneUtilsTest, TestMultiCoreConfBootstrap, ReturnFieldsTest, BasicFunctionalityTest, LegacyHTMLStripCharFilterTest, TestOmitPositions, SchemaVersionSpecificBehaviorTest, TestRealTimeGet, TestReload, TestCodecSupport, BasicZkTest, FullSolrCloudDistribCmdsTest, TestSort, DocumentBuilderTest, RecoveryZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RecoveryZkTest -Dtests.seed=3886DB3474318611 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_YE -Dtests.timezone=America/Glace_Bay -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   0.00s J1 | RecoveryZkTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=474, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([3886DB3474318611]:0)
[junit4:junit4]    > 	at java.lang.Thread.getStackTrace(Thread.java:1567)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
[junit4:junit4]    > 	at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:515)
[junit4:junit4]    > 	at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:981)
[junit4:junit4]    > 	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:873)
[junit4:junit4]    > 	at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:865)
[junit4:junit4]    > 	at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:33)
[junit4:junit4]    > 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:232)
[junit4:junit4]    > 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:192)
[junit4:junit4]    > 	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:374)
[junit4:junit4]    > 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:273)
[junit4:junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:152)
[junit4:junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:407)
[junit4:junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:222)
[junit4:junit4]    > Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/index7404574064tmp lockFactory=org.apache.lucene.store.SimpleFSLockFactory@4e52d9)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] Completed on J1 in 30.42s, 1 test, 1 error <<< FAILURES!

[...truncated 609 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:335: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:178: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1167: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:831: There were test failures: 236 suites, 980 tests, 1 suite-level error, 7 ignored (2 assumptions)

Total time: 26 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -client -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk6) - Build # 3089 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux/3089/
Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}

All tests passed

Build Log:
[...truncated 29121 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:294: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:117: The following files are missing svn:eol-style (or binary svn:mime-type):
* lucene/benchmark/src/test/org/apache/lucene/benchmark/byTask/feeds/EnwikiContentSourceTest.java

Total time: 46 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_09) - Build # 3088 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux/3088/
Java: 32bit/jdk1.7.0_09 -client -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 20119 lines...]
-check-forbidden-jdk-apis:
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/executors.txt
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/jdk-deprecated.txt
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/jdk.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning for API signatures and dependencies...
[forbidden-apis] Forbidden class use: java.io.StringBufferInputStream
[forbidden-apis]   in org.apache.lucene.benchmark.byTask.feeds.EnwikiContentSourceTest$StringableEnwikiSource (EnwikiContentSourceTest.java:44)
[forbidden-apis] Scanned 5448 (and 423 related) class file(s) for forbidden API invocations (in 2.04s), 1 error(s).

BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:67: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:163: Check for forbidden API calls failed, see log.

Total time: 32 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure