You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/16 22:23:32 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
4704 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4704/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([897B2C7E7833E7C1:89DA2660F6C87FD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9449 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4] 2> 0 T1604 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 3 T1604 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252
[junit4:junit4] 2> 3 T1604 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T1605 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 4 T1605 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T1605 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T1605 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 5 T1605 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T1605 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-1363468544252/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T1604 oasc.ZkTestServer.run start zk server on port:45380
[junit4:junit4] 2> 104 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a356a3
[junit4:junit4] 2> 105 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 105 T1610 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T1610 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 106 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59488
[junit4:junit4] 2> 106 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59488
[junit4:junit4] 2> 107 T1608 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 109 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0000 with negotiated timeout 10000 for client /127.0.0.1:59488
[junit4:junit4] 2> 109 T1610 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0000, negotiated timeout = 10000
[junit4:junit4] 2> 110 T1611 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a356a3 name:ZooKeeperConnection Watcher:127.0.0.1:45380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 110 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 111 T1604 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 113 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff0000
[junit4:junit4] 2> 113 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff0000 closed
[junit4:junit4] 2> 114 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@164b8e7
[junit4:junit4] 2> 113 T1611 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 117 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59488 which had sessionid 0x13d750ee8ff0000
[junit4:junit4] 2> 115 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 117 T1612 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 118 T1612 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 118 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59489
[junit4:junit4] 2> 118 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59489
[junit4:junit4] 2> 119 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0001 with negotiated timeout 10000 for client /127.0.0.1:59489
[junit4:junit4] 2> 119 T1612 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0001, negotiated timeout = 10000
[junit4:junit4] 2> 119 T1613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@164b8e7 name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 120 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 120 T1604 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 122 T1604 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 125 T1604 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 126 T1604 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 128 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 129 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 132 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 133 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 136 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 136 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 138 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 139 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 141 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 141 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 143 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 144 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 146 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 146 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 149 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 149 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 151 T1604 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 152 T1604 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 154 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff0001
[junit4:junit4] 2> 154 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59489 which had sessionid 0x13d750ee8ff0001
[junit4:junit4] 2> 154 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff0001 closed
[junit4:junit4] 2> 158 T1613 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 227 T1604 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 233 T1604 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47465
[junit4:junit4] 2> 234 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 234 T1604 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 235 T1604 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363468544404
[junit4:junit4] 2> 236 T1604 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363468544404/solr.xml
[junit4:junit4] 2> 236 T1604 oasc.CoreContainer.<init> New CoreContainer 20633018
[junit4:junit4] 2> 237 T1604 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363468544404/'
[junit4:junit4] 2> 237 T1604 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1363468544404/'
[junit4:junit4] 2> 266 T1604 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 266 T1604 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 267 T1604 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 267 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 268 T1604 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 268 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 269 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 269 T1604 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 270 T1604 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 270 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 280 T1604 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 293 T1604 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45380/solr
[junit4:junit4] 2> 293 T1604 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 294 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@a5198f
[junit4:junit4] 2> 294 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 295 T1623 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 295 T1623 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 295 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59490
[junit4:junit4] 2> 296 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59490
[junit4:junit4] 2> 297 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0002 with negotiated timeout 20000 for client /127.0.0.1:59490
[junit4:junit4] 2> 297 T1623 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0002, negotiated timeout = 20000
[junit4:junit4] 2> 297 T1624 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a5198f name:ZooKeeperConnection Watcher:127.0.0.1:45380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 297 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 298 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff0002
[junit4:junit4] 2> 299 T1624 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 299 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59490 which had sessionid 0x13d750ee8ff0002
[junit4:junit4] 2> 299 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff0002 closed
[junit4:junit4] 2> 299 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 302 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d5b32
[junit4:junit4] 2> 303 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 303 T1625 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 304 T1625 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 304 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59491
[junit4:junit4] 2> 304 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59491
[junit4:junit4] 2> 305 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0003 with negotiated timeout 20000 for client /127.0.0.1:59491
[junit4:junit4] 2> 305 T1625 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0003, negotiated timeout = 20000
[junit4:junit4] 2> 305 T1626 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d5b32 name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 305 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 307 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 308 T1604 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 309 T1604 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47465_
[junit4:junit4] 2> 310 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47465_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47465_
[junit4:junit4] 2> 310 T1604 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47465_
[junit4:junit4] 2> 312 T1604 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 319 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 319 T1604 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 321 T1604 oasc.Overseer.start Overseer (id=89356274516295683-127.0.0.1:47465_-n_0000000000) starting
[junit4:junit4] 2> 322 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 322 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 323 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 324 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 325 T1628 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 325 T1604 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 327 T1604 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 329 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 333 T1604 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 333 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 334 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 335 T1627 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 338 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 340 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@620300
[junit4:junit4] 2> 341 T1630 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 340 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 341 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59492
[junit4:junit4] 2> 341 T1630 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 342 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59492
[junit4:junit4] 2> 343 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0004 with negotiated timeout 10000 for client /127.0.0.1:59492
[junit4:junit4] 2> 343 T1630 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0004, negotiated timeout = 10000
[junit4:junit4] 2> 343 T1631 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@620300 name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 343 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 345 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 346 T1604 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 426 T1604 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 428 T1604 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51625
[junit4:junit4] 2> 428 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 429 T1604 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 429 T1604 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596
[junit4:junit4] 2> 429 T1604 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/solr.xml
[junit4:junit4] 2> 430 T1604 oasc.CoreContainer.<init> New CoreContainer 25791204
[junit4:junit4] 2> 430 T1604 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/'
[junit4:junit4] 2> 430 T1604 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/'
[junit4:junit4] 2> 449 T1604 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 449 T1604 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 450 T1604 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 450 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 451 T1604 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 451 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 451 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 452 T1604 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 452 T1604 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 453 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 461 T1604 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 474 T1604 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45380/solr
[junit4:junit4] 2> 474 T1604 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 475 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1aa7aac
[junit4:junit4] 2> 475 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 476 T1641 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 476 T1641 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 476 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59493
[junit4:junit4] 2> 476 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59493
[junit4:junit4] 2> 477 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0005 with negotiated timeout 20000 for client /127.0.0.1:59493
[junit4:junit4] 2> 477 T1641 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0005, negotiated timeout = 20000
[junit4:junit4] 2> 478 T1642 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aa7aac name:ZooKeeperConnection Watcher:127.0.0.1:45380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 478 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 479 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff0005
[junit4:junit4] 2> 479 T1642 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 479 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59493 which had sessionid 0x13d750ee8ff0005
[junit4:junit4] 2> 479 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff0005 closed
[junit4:junit4] 2> 480 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 483 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@203bef
[junit4:junit4] 2> 484 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 484 T1643 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 484 T1643 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 484 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59494
[junit4:junit4] 2> 485 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59494
[junit4:junit4] 2> 485 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0006 with negotiated timeout 20000 for client /127.0.0.1:59494
[junit4:junit4] 2> 485 T1643 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0006, negotiated timeout = 20000
[junit4:junit4] 2> 486 T1644 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@203bef name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 486 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 487 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:create cxid:0x1 zxid:0x2e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 488 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:create cxid:0x2 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 489 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1491 T1604 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51625_
[junit4:junit4] 2> 1492 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:delete cxid:0xb zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51625_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51625_
[junit4:junit4] 2> 1492 T1604 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51625_
[junit4:junit4] 2> 1495 T1631 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1495 T1626 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1495 T1644 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1500 T1604 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1500 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1501 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1559 T1604 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1561 T1604 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34656
[junit4:junit4] 2> 1562 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1562 T1604 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1562 T1604 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752
[junit4:junit4] 2> 1563 T1604 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/solr.xml
[junit4:junit4] 2> 1563 T1604 oasc.CoreContainer.<init> New CoreContainer 28346825
[junit4:junit4] 2> 1564 T1604 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/'
[junit4:junit4] 2> 1564 T1604 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/'
[junit4:junit4] 2> 1581 T1604 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1581 T1604 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1582 T1604 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1582 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1582 T1604 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1583 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1583 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1583 T1604 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1584 T1604 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1584 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1590 T1604 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1611 T1604 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45380/solr
[junit4:junit4] 2> 1611 T1604 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1612 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e8b58a
[junit4:junit4] 2> 1613 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1613 T1655 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1613 T1655 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 1613 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59495
[junit4:junit4] 2> 1614 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59495
[junit4:junit4] 2> 1615 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0007 with negotiated timeout 20000 for client /127.0.0.1:59495
[junit4:junit4] 2> 1615 T1655 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0007, negotiated timeout = 20000
[junit4:junit4] 2> 1615 T1656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e8b58a name:ZooKeeperConnection Watcher:127.0.0.1:45380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1615 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1616 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff0007
[junit4:junit4] 2> 1617 T1656 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1617 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59495 which had sessionid 0x13d750ee8ff0007
[junit4:junit4] 2> 1617 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff0007 closed
[junit4:junit4] 2> 1617 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1620 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@8426db
[junit4:junit4] 2> 1621 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1621 T1657 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1621 T1657 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 1621 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59496
[junit4:junit4] 2> 1622 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59496
[junit4:junit4] 2> 1622 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0008 with negotiated timeout 20000 for client /127.0.0.1:59496
[junit4:junit4] 2> 1622 T1657 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0008, negotiated timeout = 20000
[junit4:junit4] 2> 1623 T1658 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8426db name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1623 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1623 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0008 type:create cxid:0x1 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1624 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0008 type:create cxid:0x2 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1625 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2627 T1604 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34656_
[junit4:junit4] 2> 2628 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0008 type:delete cxid:0xb zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34656_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34656_
[junit4:junit4] 2> 2629 T1604 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34656_
[junit4:junit4] 2> 2631 T1631 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2631 T1626 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2631 T1658 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2631 T1644 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2636 T1604 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 2636 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2637 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2695 T1604 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 2697 T1604 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49069
[junit4:junit4] 2> 2697 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2698 T1604 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2698 T1604 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888
[junit4:junit4] 2> 2698 T1604 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/solr.xml
[junit4:junit4] 2> 2699 T1604 oasc.CoreContainer.<init> New CoreContainer 31756537
[junit4:junit4] 2> 2699 T1604 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/'
[junit4:junit4] 2> 2699 T1604 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/'
[junit4:junit4] 2> 2716 T1604 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2717 T1604 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2717 T1604 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2717 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2718 T1604 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2718 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2718 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2719 T1604 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2719 T1604 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2719 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2726 T1604 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2737 T1604 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45380/solr
[junit4:junit4] 2> 2737 T1604 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2738 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@10e5bba
[junit4:junit4] 2> 2738 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2739 T1669 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2739 T1669 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 2739 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59497
[junit4:junit4] 2> 2740 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59497
[junit4:junit4] 2> 2741 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff0009 with negotiated timeout 20000 for client /127.0.0.1:59497
[junit4:junit4] 2> 2741 T1669 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff0009, negotiated timeout = 20000
[junit4:junit4] 2> 2741 T1670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10e5bba name:ZooKeeperConnection Watcher:127.0.0.1:45380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2742 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2743 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff0009
[junit4:junit4] 2> 2744 T1670 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2744 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59497 which had sessionid 0x13d750ee8ff0009
[junit4:junit4] 2> 2744 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff0009 closed
[junit4:junit4] 2> 2744 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2747 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@27eea2
[junit4:junit4] 2> 2748 T1671 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2748 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2748 T1671 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 2748 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59498
[junit4:junit4] 2> 2748 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59498
[junit4:junit4] 2> 2749 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff000a with negotiated timeout 20000 for client /127.0.0.1:59498
[junit4:junit4] 2> 2749 T1671 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff000a, negotiated timeout = 20000
[junit4:junit4] 2> 2750 T1672 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27eea2 name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2750 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2751 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff000a type:create cxid:0x1 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2751 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff000a type:create cxid:0x2 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2753 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3755 T1604 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49069_
[junit4:junit4] 2> 3756 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff000a type:delete cxid:0xb zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49069_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49069_
[junit4:junit4] 2> 3757 T1604 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49069_
[junit4:junit4] 2> 3759 T1631 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3759 T1644 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3760 T1658 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3760 T1626 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3762 T1672 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3766 T1604 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3767 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3767 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3825 T1604 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3827 T1604 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36300
[junit4:junit4] 2> 3828 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3828 T1604 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3829 T1604 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363468548018
[junit4:junit4] 2> 3829 T1604 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363468548018/solr.xml
[junit4:junit4] 2> 3829 T1604 oasc.CoreContainer.<init> New CoreContainer 3355470
[junit4:junit4] 2> 3830 T1604 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363468548018/'
[junit4:junit4] 2> 3830 T1604 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1363468548018/'
[junit4:junit4] 2> 3856 T1604 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3857 T1604 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3857 T1604 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3857 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3858 T1604 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3858 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3858 T1604 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3859 T1604 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3859 T1604 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3859 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3866 T1604 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3877 T1604 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45380/solr
[junit4:junit4] 2> 3877 T1604 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3878 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@47c884
[junit4:junit4] 2> 3878 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3879 T1683 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3879 T1683 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 3879 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59501
[junit4:junit4] 2> 3880 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59501
[junit4:junit4] 2> 3880 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff000b with negotiated timeout 20000 for client /127.0.0.1:59501
[junit4:junit4] 2> 3880 T1683 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff000b, negotiated timeout = 20000
[junit4:junit4] 2> 3881 T1684 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47c884 name:ZooKeeperConnection Watcher:127.0.0.1:45380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3881 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3882 T1609 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d750ee8ff000b
[junit4:junit4] 2> 3882 T1684 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3882 T1606 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:59501 which had sessionid 0x13d750ee8ff000b
[junit4:junit4] 2> 3882 T1604 oaz.ZooKeeper.close Session: 0x13d750ee8ff000b closed
[junit4:junit4] 2> 3883 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3886 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@d41f44
[junit4:junit4] 2> 3887 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3887 T1685 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3887 T1685 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 3887 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59502
[junit4:junit4] 2> 3888 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59502
[junit4:junit4] 2> 3888 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff000c with negotiated timeout 20000 for client /127.0.0.1:59502
[junit4:junit4] 2> 3888 T1685 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff000c, negotiated timeout = 20000
[junit4:junit4] 2> 3889 T1686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d41f44 name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3889 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3890 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff000c type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3890 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff000c type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3892 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4894 T1604 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36300_
[junit4:junit4] 2> 4895 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff000c type:delete cxid:0xb zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36300_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36300_
[junit4:junit4] 2> 4895 T1604 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36300_
[junit4:junit4] 2> 4898 T1672 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 4898 T1644 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 4898 T1658 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 4898 T1631 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 4899 T1686 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 4898 T1626 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 4906 T1604 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 4907 T1604 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4907 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4909 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4913 T1639 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/unloadcollection1
[junit4:junit4] 2> 4913 T1639 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 4914 T1639 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4] 2> 4914 T1639 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 4915 T1639 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 4916 T1639 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4] 2> 4918 T1639 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 4919 T1639 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/unloadcollection1/'
[junit4:junit4] 2> 4945 T1639 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4987 T1639 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4989 T1639 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4993 T1639 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5401 T1639 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5407 T1639 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5410 T1639 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5419 T1639 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5422 T1639 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5425 T1639 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5426 T1639 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5427 T1639 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5427 T1639 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5428 T1639 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5428 T1639 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5429 T1639 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5429 T1639 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n/
[junit4:junit4] 2> 5429 T1639 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d192f4
[junit4:junit4] 2> 5430 T1639 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5430 T1639 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n forceNew: false
[junit4:junit4] 2> 5431 T1639 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n/index/
[junit4:junit4] 2> 5431 T1639 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5431 T1639 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n/index forceNew: false
[junit4:junit4] 2> 5433 T1639 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5433 T1639 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5434 T1639 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5435 T1639 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5435 T1639 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5436 T1639 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5436 T1639 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5436 T1639 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5437 T1639 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5437 T1639 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5437 T1639 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5440 T1639 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5442 T1639 oass.SolrIndexSearcher.<init> Opening Searcher@f2cbbb main
[junit4:junit4] 2> 5443 T1639 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n/tlog
[junit4:junit4] 2> 5443 T1639 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5444 T1639 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5446 T1688 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@f2cbbb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5447 T1639 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4] 2> 5448 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:create cxid:0x40 zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 6343 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6343 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:51625_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51625",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 6344 T1627 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4] 2> 6344 T1627 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6344 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0003 type:create cxid:0x46 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 6350 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6350 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6350 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6350 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6350 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6350 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6450 T1639 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4] 2> 6450 T1639 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:51625 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 6451 T1639 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 2> 6456 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:delete cxid:0x51 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4] 2> 6457 T1639 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6457 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:create cxid:0x52 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6459 T1639 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6459 T1639 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6459 T1639 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51625/unloadcollection1/
[junit4:junit4] 2> 6460 T1639 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6460 T1639 oasc.SyncStrategy.syncToMe http://127.0.0.1:51625/unloadcollection1/ has no replicas
[junit4:junit4] 2> 6460 T1639 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51625/unloadcollection1/
[junit4:junit4] 2> 6460 T1639 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4] 2> 6464 T1609 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d750ee8ff0006 type:create cxid:0x5c zxid:0x5e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7854 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7859 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7859 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7860 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7859 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7860 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7860 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7869 T1639 oasc.ZkController.register We are http://127.0.0.1:51625/unloadcollection1/ and leader is http://127.0.0.1:51625/unloadcollection1/
[junit4:junit4] 2> 7870 T1639 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:51625
[junit4:junit4] 2> 7870 T1639 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7870 T1639 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4] 2> 7873 T1639 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7873 T1639 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/solr.xml
[junit4:junit4] 2> 7880 T1639 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1363468544596/solr.xml
[junit4:junit4] 2> 7881 T1639 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=unloadcollection&name=unloadcollection1&version=2&wt=javabin&action=CREATE&numShards=1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468549161unloadcollection1_1n} status=0 QTime=2968
[junit4:junit4] 2> 7882 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 7883 T1604 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45380/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16cc298
[junit4:junit4] 2> 7884 T1604 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7884 T1689 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45380. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7885 T1689 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45380, initiating session
[junit4:junit4] 2> 7885 T1606 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:59508
[junit4:junit4] 2> 7885 T1606 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:59508
[junit4:junit4] 2> 7886 T1608 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d750ee8ff000d with negotiated timeout 10000 for client /127.0.0.1:59508
[junit4:junit4] 2> 7886 T1689 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45380, sessionid = 0x13d750ee8ff000d, negotiated timeout = 10000
[junit4:junit4] 2> 7886 T1690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16cc298 name:ZooKeeperConnection Watcher:127.0.0.1:45380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7886 T1604 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7888 T1604 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 7890 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7891 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7894 T1651 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/unloadcollection2
[junit4:junit4] 2> 7894 T1651 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 7895 T1651 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 7895 T1651 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 7896 T1651 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/unloadcollection2/'
[junit4:junit4] 2> 7934 T1651 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 7969 T1651 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7971 T1651 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7977 T1651 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8423 T1651 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8429 T1651 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8432 T1651 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8442 T1651 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8445 T1651 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8448 T1651 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8449 T1651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8450 T1651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8450 T1651 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8451 T1651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8451 T1651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8451 T1651 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8452 T1651 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n/
[junit4:junit4] 2> 8453 T1651 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d192f4
[junit4:junit4] 2> 8453 T1651 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8454 T1651 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n forceNew: false
[junit4:junit4] 2> 8454 T1651 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n/index/
[junit4:junit4] 2> 8454 T1651 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8455 T1651 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n/index forceNew: false
[junit4:junit4] 2> 8456 T1651 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@658335 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c30bb8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8456 T1651 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8458 T1651 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8458 T1651 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8459 T1651 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8459 T1651 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8459 T1651 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8460 T1651 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8460 T1651 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8460 T1651 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8461 T1651 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8463 T1651 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8466 T1651 oass.SolrIndexSearcher.<init> Opening Searcher@8dd8 main
[junit4:junit4] 2> 8466 T1651 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n/tlog
[junit4:junit4] 2> 8467 T1651 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8467 T1651 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8471 T1691 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@8dd8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8472 T1651 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4] 2> 8473 T1651 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9365 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9365 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:51625_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51625",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51625__unloadcollection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 9369 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:34656_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34656",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 9369 T1627 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 9369 T1627 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9372 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9372 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9372 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9372 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9372 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9372 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9372 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9475 T1651 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4] 2> 9475 T1651 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:34656 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 9478 T1651 oasc.ZkController.register We are http://127.0.0.1:34656/unloadcollection2/ and leader is http://127.0.0.1:51625/unloadcollection1/
[junit4:junit4] 2> 9478 T1651 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:34656
[junit4:junit4] 2> 9479 T1651 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4] 2> 9479 T1651 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C127 name=unloadcollection2 org.apache.solr.core.SolrCore@115aec2 url=http://127.0.0.1:34656/unloadcollection2 node=127.0.0.1:34656_ C127_STATE=coll:unloadcollection core:unloadcollection2 props:{node_name=127.0.0.1:34656_, collection=unloadcollection, state=down, base_url=http://127.0.0.1:34656, core=unloadcollection2}
[junit4:junit4] 2> 9479 T1692 C127 P34656 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4] 2> 9480 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 9480 T1651 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9480 T1692 C127 P34656 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4] 2> 9481 T1692 C127 P34656 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9481 T1651 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/solr.xml
[junit4:junit4] 2> 9482 T1692 C127 P34656 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 9487 T1651 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1363468545752/solr.xml
[junit4:junit4] 2> 9488 T1651 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=unloadcollection&name=unloadcollection2&version=2&wt=javabin&action=CREATE&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n} status=0 QTime=1594
[junit4:junit4] 2> 9489 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9490 T1604 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 9491 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10492 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10885 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10886 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:34656_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34656",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34656__unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 10889 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10889 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10889 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10890 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10889 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10889 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10890 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11486 T1638 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&version=2&nodeName=127.0.0.1:34656_&onlyIfLeader=true&core=unloadcollection1&wt=javabin&action=PREPRECOVERY&checkLive=true&coreNodeName=127.0.0.1:34656__unloadcollection2} status=0 QTime=2001
[junit4:junit4] 2> 11494 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12495 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C127_STATE=coll:unloadcollection core:unloadcollection2 props:{node_name=127.0.0.1:34656_, collection=unloadcollection, state=recovering, shard=shard1, base_url=http://127.0.0.1:34656, core=unloadcollection2}
[junit4:junit4] 2> 13487 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51625/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4] 2> 13487 T1692 C127 P34656 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:34656 START replicas=[http://127.0.0.1:51625/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 13488 T1692 C127 P34656 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 13488 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4] 2> 13488 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4] 2> 13488 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4] 2> 13488 T1692 C127 P34656 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 13488 T1692 C127 P34656 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51625/unloadcollection1/. core=unloadcollection2
[junit4:junit4] 2> 13489 T1692 C127 P34656 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C128 name=unloadcollection1 org.apache.solr.core.SolrCore@6842a2 url=http://127.0.0.1:51625/unloadcollection1 node=127.0.0.1:51625_ C128_STATE=coll:unloadcollection core:unloadcollection1 props:{node_name=127.0.0.1:51625_, collection=unloadcollection, state=active, shard=shard1, base_url=http://127.0.0.1:51625, core=unloadcollection1, leader=true}
[junit4:junit4] 2> 13493 T1640 C128 P51625 REQ /get {getVersions=100&distrib=false&version=2&wt=javabin&qt=/get} status=0 QTime=1
[junit4:junit4] 2> 13493 T1637 C128 P51625 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 13496 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13545 T1637 C128 P51625 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13545 T1637 C128 P51625 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13546 T1637 C128 P51625 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13547 T1637 C128 P51625 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13547 T1637 C128 P51625 oass.SolrIndexSearcher.<init> Opening Searcher@16b8f58 realtime
[junit4:junit4] 2> 13548 T1637 C128 P51625 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 13548 T1637 C128 P51625 /update {waitSearcher=true&softCommit=false&version=2&openSearcher=false&wt=javabin&commit=true&commit_end_point=true} {commit=} 0 55
[junit4:junit4] 2> 13549 T1692 C127 P34656 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13549 T1692 C127 P34656 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 13553 T1639 C128 P51625 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13554 T1639 C128 P51625 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=4
[junit4:junit4] 2> 13554 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 13554 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 13554 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 13556 T1640 C128 P51625 REQ /replication {generation=2&version=2&wt=javabin&qt=/replication&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 13556 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 13557 T1692 C127 P34656 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468552142unloadcollection1_2n/index.20130316141557806 forceNew: false
[junit4:junit4] 2> 13558 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2e1822 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b5c1e3; maxCacheMB=0.3232421875 maxMergeSizeMB=0.9453125))) fullCopy=false
[junit4:junit4] 2> 13560 T1637 C128 P51625 REQ /replication {generation=2&checksum=true&file=segments_2&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 13561 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 13562 T1692 C127 P34656 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 13562 T1692 C127 P34656 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4] 2> 13563 T1692 C127 P34656 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@658335 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c30bb8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@658335 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c30bb8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13563 T1692 C127 P34656 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13563 T1692 C127 P34656 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 13564 T1692 C127 P34656 oass.SolrIndexSearcher.<init> Opening Searcher@1efa6c1 main
[junit4:junit4] 2> 13565 T1691 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@1efa6c1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 13565 T1692 C127 P34656 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2e1822 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b5c1e3; maxCacheMB=0.3232421875 maxMergeSizeMB=0.9453125)))
[junit4:junit4] 2> 13565 T1692 C127 P34656 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4] 2> 13565 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4] 2> 13566 T1692 C127 P34656 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4] 2> 13566 T1692 C127 P34656 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13567 T1692 C127 P34656 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4] 2> 13895 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13895 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:34656_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34656",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34656__unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 13899 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13899 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13899 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13899 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13899 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13899 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13899 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14498 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14499 T1604 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 14499 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C127_STATE=coll:unloadcollection core:unloadcollection2 props:{node_name=127.0.0.1:34656_, collection=unloadcollection, state=active, shard=shard1, base_url=http://127.0.0.1:34656, core=unloadcollection2}
[junit4:junit4] 2> 14510 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[6 (1429700407461937152)]} 0 1
[junit4:junit4] 2> 14511 T1638 C128 P51625 /update {version=2&wt=javabin} {add=[6 (1429700407461937152)]} 0 8
[junit4:junit4] 2> 14516 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[7 (1429700407472422912)]} 0 1
[junit4:junit4] 2> 14516 T1639 C128 P51625 /update {version=2&wt=javabin} {add=[7 (1429700407472422912)]} 0 3
[junit4:junit4] 2> 14521 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[8 (1429700407477665792)]} 0 0
[junit4:junit4] 2> 14522 T1640 C128 P51625 /update {version=2&wt=javabin} {add=[8 (1429700407477665792)]} 0 4
[junit4:junit4] 2> 14524 T1637 C128 P51625 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14526 T1637 C128 P51625 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, _0.fdt, segments_3]
[junit4:junit4] 2> 14527 T1637 C128 P51625 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, _0.fdt, segments_3]
[junit4:junit4] 2> 14528 T1637 C128 P51625 oass.SolrIndexSearcher.<init> Opening Searcher@14fbcda main
[junit4:junit4] 2> 14529 T1637 C128 P51625 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14530 T1688 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@14fbcda main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C3)}
[junit4:junit4] 2> 14530 T1637 C128 P51625 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:34656/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 14532 T1654 C127 P34656 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14535 T1654 C127 P34656 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@658335 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c30bb8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@658335 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c30bb8),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, _0.fdt, segments_3]
[junit4:junit4] 2> 14536 T1654 C127 P34656 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, _0.fdt, segments_3]
[junit4:junit4] 2> 14537 T1654 C127 P34656 oass.SolrIndexSearcher.<init> Opening Searcher@1c23c68 main
[junit4:junit4] 2> 14538 T1654 C127 P34656 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14538 T1691 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@1c23c68 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C3)}
[junit4:junit4] 2> 14539 T1654 C127 P34656 /update {expungeDeletes=false&waitSearcher=true&softCommit=false&version=2&wt=javabin&commit=true&commit_end_point=true} {commit=} 0 7
[junit4:junit4] 2> 14539 T1637 C128 P51625 /update {waitSearcher=true&softCommit=false&version=2&wt=javabin&commit=true} {commit=} 0 15
[junit4:junit4] 2> 14540 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14543 T1666 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/unloadcollection3
[junit4:junit4] 2> 14544 T1666 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 14545 T1666 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14545 T1666 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 14546 T1666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/unloadcollection3/'
[junit4:junit4] 2> 14583 T1666 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 14636 T1666 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14637 T1666 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14642 T1666 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15088 T1666 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15094 T1666 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15097 T1666 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15109 T1666 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15113 T1666 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15116 T1666 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15117 T1666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15118 T1666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15118 T1666 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15119 T1666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15119 T1666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15120 T1666 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15120 T1666 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n/
[junit4:junit4] 2> 15120 T1666 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d192f4
[junit4:junit4] 2> 15121 T1666 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15121 T1666 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n forceNew: false
[junit4:junit4] 2> 15122 T1666 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n/index/
[junit4:junit4] 2> 15122 T1666 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15122 T1666 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n/index forceNew: false
[junit4:junit4] 2> 15124 T1666 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1007cce lockFactory=org.apache.lucene.store.NativeFSLockFactory@18675d3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15124 T1666 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15125 T1666 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15126 T1666 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15126 T1666 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15127 T1666 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15127 T1666 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15127 T1666 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15128 T1666 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15128 T1666 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15128 T1666 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15131 T1666 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15133 T1666 oass.SolrIndexSearcher.<init> Opening Searcher@8809e1 main
[junit4:junit4] 2> 15134 T1666 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n/tlog
[junit4:junit4] 2> 15134 T1666 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15134 T1666 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15138 T1696 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@8809e1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15140 T1666 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4] 2> 15140 T1666 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15403 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15404 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:49069_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49069",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 15404 T1627 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 15404 T1627 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15407 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15407 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15407 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15408 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15407 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15407 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15407 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16142 T1666 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4] 2> 16143 T1666 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:49069 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 16146 T1666 oasc.ZkController.register We are http://127.0.0.1:49069/unloadcollection3/ and leader is http://127.0.0.1:51625/unloadcollection1/
[junit4:junit4] 2> 16146 T1666 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:49069
[junit4:junit4] 2> 16147 T1666 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4] 2> 16147 T1666 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C129 name=unloadcollection3 org.apache.solr.core.SolrCore@1dc2d96 url=http://127.0.0.1:49069/unloadcollection3 node=127.0.0.1:49069_ C129_STATE=coll:unloadcollection core:unloadcollection3 props:{node_name=127.0.0.1:49069_, collection=unloadcollection, state=down, base_url=http://127.0.0.1:49069, core=unloadcollection3}
[junit4:junit4] 2> 16148 T1697 C129 P49069 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4] 2> 16148 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16148 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16149 T1697 C129 P49069 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4] 2> 16149 T1697 C129 P49069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16149 T1666 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/solr.xml
[junit4:junit4] 2> 16150 T1697 C129 P49069 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16159 T1666 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1363468546888/solr.xml
[junit4:junit4] 2> 16160 T1666 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=unloadcollection&name=unloadcollection3&version=2&wt=javabin&action=CREATE&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n} status=0 QTime=1617
[junit4:junit4] 2> 16161 T1604 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 16162 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16911 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16912 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:49069_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49069",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49069__unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 16915 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16915 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16916 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16915 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16915 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16915 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16916 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17153 T1639 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&version=2&nodeName=127.0.0.1:49069_&onlyIfLeader=true&core=unloadcollection1&wt=javabin&action=PREPRECOVERY&checkLive=true&coreNodeName=127.0.0.1:49069__unloadcollection3} status=0 QTime=1000
[junit4:junit4] 2> 17163 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18165 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C129_STATE=coll:unloadcollection core:unloadcollection3 props:{node_name=127.0.0.1:49069_, collection=unloadcollection, state=recovering, shard=shard1, base_url=http://127.0.0.1:49069, core=unloadcollection3}
[junit4:junit4] 2> 19154 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51625/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4] 2> 19155 T1697 C129 P49069 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:49069 START replicas=[http://127.0.0.1:51625/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 19155 T1697 C129 P49069 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19155 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4] 2> 19155 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4] 2> 19156 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4] 2> 19156 T1697 C129 P49069 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19156 T1697 C129 P49069 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51625/unloadcollection1/. core=unloadcollection3
[junit4:junit4] 2> 19156 T1697 C129 P49069 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19157 T1638 C128 P51625 REQ /get {getVersions=100&distrib=false&version=2&wt=javabin&qt=/get} status=0 QTime=0
[junit4:junit4] 2> 19160 T1637 C128 P51625 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19161 T1637 C128 P51625 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, _0.fdt, segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c5e091 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e746ef),segFN=segments_4,generation=4,filenames=[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, segments_4, _0.fdt]
[junit4:junit4] 2> 19161 T1637 C128 P51625 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_Lucene40_0.prx, _0_nrm.cfs, _0.fdx, _0_Lucene40_0.tim, _0_nrm.cfe, _0.fnm, _0_Lucene40_0.tip, _0.si, _0_Lucene40_0.frq, segments_4, _0.fdt]
[junit4:junit4] 2> 19161 T1637 C128 P51625 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19162 T1637 C128 P51625 /update {waitSearcher=true&softCommit=false&version=2&openSearcher=false&wt=javabin&commit=true&commit_end_point=true} {commit=} 0 2
[junit4:junit4] 2> 19162 T1697 C129 P49069 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19163 T1697 C129 P49069 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19164 T1638 C128 P51625 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4:junit4] 2> 19165 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 19165 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19165 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19167 T1639 C128 P51625 REQ /replication {generation=4&version=2&wt=javabin&qt=/replication&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 19167 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19167 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 11
[junit4:junit4] 2> 19169 T1697 C129 P49069 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1363468544252/1363468558791unloadcollection_3n/index.20130316141603417 forceNew: false
[junit4:junit4] 2> 19169 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@c095f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@cb56f3; maxCacheMB=0.3232421875 maxMergeSizeMB=0.9453125))) fullCopy=false
[junit4:junit4] 2> 19171 T1637 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0_Lucene40_0.prx&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19174 T1640 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0_nrm.cfs&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=1
[junit4:junit4] 2> 19176 T1638 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0_Lucene40_0.tim&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19186 T1639 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0.fdx&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19189 T1637 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0.fnm&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19191 T1640 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0_nrm.cfe&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19194 T1638 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0_Lucene40_0.tip&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19196 T1639 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0_Lucene40_0.frq&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19199 T1637 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0.si&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19201 T1640 C128 P51625 REQ /replication {generation=4&checksum=true&file=segments_4&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19203 T1638 C128 P51625 REQ /replication {generation=4&checksum=true&file=_0.fdt&wt=filestream&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19204 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19205 T1697 C129 P49069 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19205 T1697 C129 P49069 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4] 2> 19206 T1697 C129 P49069 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1007cce lockFactory=org.apache.lucene.store.NativeFSLockFactory@18675d3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1007cce lockFactory=org.apache.lucene.store.NativeFSLockFactory@18675d3),segFN=segments_4,generation=4,filenames=[_0_Lucene40_0.prx, _0_nrm.cfs, _0_Lucene40_0.tim, _0.fdx, _0.fnm, _0_nrm.cfe, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0.si, segments_4, _0.fdt]
[junit4:junit4] 2> 19206 T1697 C129 P49069 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_Lucene40_0.prx, _0_nrm.cfs, _0_Lucene40_0.tim, _0.fdx, _0.fnm, _0_nrm.cfe, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0.si, segments_4, _0.fdt]
[junit4:junit4] 2> 19207 T1697 C129 P49069 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19207 T1697 C129 P49069 oass.SolrIndexSearcher.<init> Opening Searcher@1af600c main
[junit4:junit4] 2> 19208 T1696 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@1af600c main{StandardDirectoryReader(segments_4:3:nrt _0(4.3):C3)}
[junit4:junit4] 2> 19208 T1697 C129 P49069 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@c095f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@cb56f3; maxCacheMB=0.3232421875 maxMergeSizeMB=0.9453125)))
[junit4:junit4] 2> 19209 T1697 C129 P49069 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4] 2> 19209 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4] 2> 19209 T1697 C129 P49069 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4] 2> 19209 T1697 C129 P49069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19211 T1697 C129 P49069 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4] 2> 19921 T1627 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19922 T1627 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:49069_",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49069",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49069__unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 19925 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19926 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19926 T1644 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19926 T1658 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19926 T1686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19926 T1626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19926 T1672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20169 T1604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20171 T1604 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 20171 T1604 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C129_STATE=coll:unloadcollection core:unloadcollection3 props:{node_name=127.0.0.1:49069_, collection=unloadcollection, state=active, shard=shard1, base_url=http://127.0.0.1:49069, core=unloadcollection3}
[junit4:junit4] 2> 20184 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[20 (1429700413415751680)]} 0 1
[junit4:junit4] 2> 20184 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[20 (1429700413415751680)]} 0 0
[junit4:junit4] 2> 20185 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[20 (1429700413415751680)]} 0 4
[junit4:junit4] 2> 20185 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[20]} 0 5
[junit4:junit4] 2> 20192 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[21 (1429700413424140288)]} 0 1
[junit4:junit4] 2> 20192 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[21 (1429700413424140288)]} 0 1
[junit4:junit4] 2> 20193 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[21 (1429700413424140288)]} 0 4
[junit4:junit4] 2> 20193 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[21]} 0 6
[junit4:junit4] 2> 20199 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[22 (1429700413432528896)]} 0 0
[junit4:junit4] 2> 20200 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[22 (1429700413432528896)]} 0 1
[junit4:junit4] 2> 20200 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[22 (1429700413432528896)]} 0 3
[junit4:junit4] 2> 20201 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[22]} 0 6
[junit4:junit4] 2> 20207 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[23 (1429700413439868928)]} 0 1
[junit4:junit4] 2> 20207 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[23 (1429700413439868928)]} 0 1
[junit4:junit4] 2> 20207 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[23 (1429700413439868928)]} 0 3
[junit4:junit4] 2> 20208 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[23]} 0 5
[junit4:junit4] 2> 20213 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[24 (1429700413447208960)]} 0 0
[junit4:junit4] 2> 20213 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[24 (1429700413447208960)]} 0 0
[junit4:junit4] 2> 20214 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[24 (1429700413447208960)]} 0 3
[junit4:junit4] 2> 20214 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[24]} 0 4
[junit4:junit4] 2> 20219 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[25 (1429700413453500416)]} 0 0
[junit4:junit4] 2> 20219 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[25 (1429700413453500416)]} 0 0
[junit4:junit4] 2> 20220 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[25 (1429700413453500416)]} 0 3
[junit4:junit4] 2> 20220 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[25]} 0 4
[junit4:junit4] 2> 20226 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[26 (1429700413460840448)]} 0 1
[junit4:junit4] 2> 20226 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[26 (1429700413460840448)]} 0 1
[junit4:junit4] 2> 20227 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[26 (1429700413460840448)]} 0 4
[junit4:junit4] 2> 20227 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[26]} 0 5
[junit4:junit4] 2> 20232 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[27 (1429700413467131904)]} 0 0
[junit4:junit4] 2> 20232 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[27 (1429700413467131904)]} 0 0
[junit4:junit4] 2> 20233 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[27 (1429700413467131904)]} 0 3
[junit4:junit4] 2> 20233 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[27]} 0 4
[junit4:junit4] 2> 20239 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[28 (1429700413473423360)]} 0 0
[junit4:junit4] 2> 20239 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[28 (1429700413473423360)]} 0 0
[junit4:junit4] 2> 20240 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[28 (1429700413473423360)]} 0 4
[junit4:junit4] 2> 20240 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[28]} 0 5
[junit4:junit4] 2> 20246 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[29 (1429700413481811968)]} 0 0
[junit4:junit4] 2> 20246 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[29 (1429700413481811968)]} 0 0
[junit4:junit4] 2> 20247 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[29 (1429700413481811968)]} 0 3
[junit4:junit4] 2> 20248 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[29]} 0 6
[junit4:junit4] 2> 20254 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[30 (1429700413489152000)]} 0 1
[junit4:junit4] 2> 20254 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[30 (1429700413489152000)]} 0 0
[junit4:junit4] 2> 20255 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[30 (1429700413489152000)]} 0 4
[junit4:junit4] 2> 20255 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[30]} 0 6
[junit4:junit4] 2> 20261 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[31 (1429700413497540608)]} 0 0
[junit4:junit4] 2> 20261 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[31 (1429700413497540608)]} 0 1
[junit4:junit4] 2> 20262 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[31 (1429700413497540608)]} 0 3
[junit4:junit4] 2> 20262 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[31]} 0 5
[junit4:junit4] 2> 20268 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[32 (1429700413504880640)]} 0 0
[junit4:junit4] 2> 20268 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[32 (1429700413504880640)]} 0 0
[junit4:junit4] 2> 20269 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[32 (1429700413504880640)]} 0 3
[junit4:junit4] 2> 20269 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[32]} 0 5
[junit4:junit4] 2> 20275 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[33 (1429700413512220672)]} 0 1
[junit4:junit4] 2> 20275 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[33 (1429700413512220672)]} 0 1
[junit4:junit4] 2> 20276 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[33 (1429700413512220672)]} 0 3
[junit4:junit4] 2> 20276 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[33]} 0 5
[junit4:junit4] 2> 20282 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[34 (1429700413518512128)]} 0 1
[junit4:junit4] 2> 20282 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[34 (1429700413518512128)]} 0 1
[junit4:junit4] 2> 20282 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[34 (1429700413518512128)]} 0 3
[junit4:junit4] 2> 20283 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[34]} 0 5
[junit4:junit4] 2> 20288 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[35 (1429700413525852160)]} 0 0
[junit4:junit4] 2> 20288 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[35 (1429700413525852160)]} 0 0
[junit4:junit4] 2> 20289 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[35 (1429700413525852160)]} 0 3
[junit4:junit4] 2> 20289 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[35]} 0 4
[junit4:junit4] 2> 20295 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[36 (1429700413533192192)]} 0 1
[junit4:junit4] 2> 20295 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[36 (1429700413533192192)]} 0 0
[junit4:junit4] 2> 20296 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[36 (1429700413533192192)]} 0 3
[junit4:junit4] 2> 20296 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[36]} 0 5
[junit4:junit4] 2> 20302 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[37 (1429700413539483648)]} 0 1
[junit4:junit4] 2> 20302 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[37 (1429700413539483648)]} 0 1
[junit4:junit4] 2> 20302 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[37 (1429700413539483648)]} 0 3
[junit4:junit4] 2> 20303 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[37]} 0 5
[junit4:junit4] 2> 20308 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[38 (1429700413546823680)]} 0 0
[junit4:junit4] 2> 20308 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[38 (1429700413546823680)]} 0 0
[junit4:junit4] 2> 20309 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[38 (1429700413546823680)]} 0 3
[junit4:junit4] 2> 20310 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[38]} 0 5
[junit4:junit4] 2> 20315 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[39 (1429700413554163712)]} 0 0
[junit4:junit4] 2> 20315 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[39 (1429700413554163712)]} 0 0
[junit4:junit4] 2> 20316 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[39 (1429700413554163712)]} 0 3
[junit4:junit4] 2> 20317 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[39]} 0 6
[junit4:junit4] 2> 20322 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[40 (1429700413561503744)]} 0 0
[junit4:junit4] 2> 20322 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[40 (1429700413561503744)]} 0 0
[junit4:junit4] 2> 20323 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[40 (1429700413561503744)]} 0 3
[junit4:junit4] 2> 20323 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[40]} 0 5
[junit4:junit4] 2> 20329 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[41 (1429700413568843776)]} 0 0
[junit4:junit4] 2> 20330 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[41 (1429700413568843776)]} 0 1
[junit4:junit4] 2> 20330 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[41 (1429700413568843776)]} 0 3
[junit4:junit4] 2> 20331 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[41]} 0 6
[junit4:junit4] 2> 20336 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[42 (1429700413576183808)]} 0 0
[junit4:junit4] 2> 20336 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[42 (1429700413576183808)]} 0 0
[junit4:junit4] 2> 20337 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[42 (1429700413576183808)]} 0 3
[junit4:junit4] 2> 20338 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[42]} 0 6
[junit4:junit4] 2> 20343 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[43 (1429700413583523840)]} 0 0
[junit4:junit4] 2> 20343 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[43 (1429700413583523840)]} 0 0
[junit4:junit4] 2> 20344 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[43 (1429700413583523840)]} 0 3
[junit4:junit4] 2> 20344 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[43]} 0 5
[junit4:junit4] 2> 20350 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[44 (1429700413590863872)]} 0 0
[junit4:junit4] 2> 20350 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[44 (1429700413590863872)]} 0 0
[junit4:junit4] 2> 20351 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[44 (1429700413590863872)]} 0 3
[junit4:junit4] 2> 20352 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[44]} 0 6
[junit4:junit4] 2> 20357 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[45 (1429700413598203904)]} 0 0
[junit4:junit4] 2> 20358 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[45 (1429700413598203904)]} 0 0
[junit4:junit4] 2> 20359 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[45 (1429700413598203904)]} 0 4
[junit4:junit4] 2> 20359 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[45]} 0 5
[junit4:junit4] 2> 20365 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[46 (1429700413605543936)]} 0 1
[junit4:junit4] 2> 20365 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[46 (1429700413605543936)]} 0 1
[junit4:junit4] 2> 20365 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[46 (1429700413605543936)]} 0 3
[junit4:junit4] 2> 20366 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[46]} 0 5
[junit4:junit4] 2> 20371 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[47 (1429700413612883968)]} 0 0
[junit4:junit4] 2> 20372 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[47 (1429700413612883968)]} 0 1
[junit4:junit4] 2> 20372 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[47 (1429700413612883968)]} 0 3
[junit4:junit4] 2> 20373 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[47]} 0 5
[junit4:junit4] 2> 20388 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[48 (1429700413620224000)]} 0 0
[junit4:junit4] 2> 20388 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[48 (1429700413620224000)]} 0 0
[junit4:junit4] 2> 20389 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[48 (1429700413620224000)]} 0 13
[junit4:junit4] 2> 20390 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[48]} 0 16
[junit4:junit4] 2> 20395 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[49 (1429700413638049792)]} 0 0
[junit4:junit4] 2> 20395 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[49 (1429700413638049792)]} 0 0
[junit4:junit4] 2> 20396 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[49 (1429700413638049792)]} 0 3
[junit4:junit4] 2> 20397 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[49]} 0 6
[junit4:junit4] 2> 20402 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[50 (1429700413645389824)]} 0 0
[junit4:junit4] 2> 20403 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[50 (1429700413645389824)]} 0 1
[junit4:junit4] 2> 20403 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[50 (1429700413645389824)]} 0 3
[junit4:junit4] 2> 20404 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[50]} 0 6
[junit4:junit4] 2> 20410 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[51 (1429700413652729856)]} 0 1
[junit4:junit4] 2> 20410 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[51 (1429700413652729856)]} 0 1
[junit4:junit4] 2> 20410 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[51 (1429700413652729856)]} 0 3
[junit4:junit4] 2> 20411 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[51]} 0 5
[junit4:junit4] 2> 20416 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[52 (1429700413660069888)]} 0 0
[junit4:junit4] 2> 20416 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[52 (1429700413660069888)]} 0 0
[junit4:junit4] 2> 20417 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[52 (1429700413660069888)]} 0 3
[junit4:junit4] 2> 20418 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[52]} 0 5
[junit4:junit4] 2> 20423 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[53 (1429700413667409920)]} 0 0
[junit4:junit4] 2> 20423 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[53 (1429700413667409920)]} 0 0
[junit4:junit4] 2> 20424 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[53 (1429700413667409920)]} 0 3
[junit4:junit4] 2> 20425 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[53]} 0 6
[junit4:junit4] 2> 20431 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[54 (1429700413674749952)]} 0 1
[junit4:junit4] 2> 20431 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[54 (1429700413674749952)]} 0 1
[junit4:junit4] 2> 20432 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[54 (1429700413674749952)]} 0 4
[junit4:junit4] 2> 20432 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[54]} 0 6
[junit4:junit4] 2> 20439 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[55 (1429700413683138560)]} 0 1
[junit4:junit4] 2> 20440 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[55 (1429700413683138560)]} 0 1
[junit4:junit4] 2> 20440 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[55 (1429700413683138560)]} 0 4
[junit4:junit4] 2> 20441 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[55]} 0 7
[junit4:junit4] 2> 20446 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[56 (1429700413691527168)]} 0 1
[junit4:junit4] 2> 20446 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[56 (1429700413691527168)]} 0 1
[junit4:junit4] 2> 20446 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[56 (1429700413691527168)]} 0 2
[junit4:junit4] 2> 20447 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[56]} 0 5
[junit4:junit4] 2> 20453 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[57 (1429700413698867200)]} 0 1
[junit4:junit4] 2> 20453 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[57 (1429700413698867200)]} 0 1
[junit4:junit4] 2> 20453 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[57 (1429700413698867200)]} 0 2
[junit4:junit4] 2> 20454 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[57]} 0 5
[junit4:junit4] 2> 20459 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[58 (1429700413705158656)]} 0 1
[junit4:junit4] 2> 20459 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[58 (1429700413705158656)]} 0 1
[junit4:junit4] 2> 20460 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[58 (1429700413705158656)]} 0 3
[junit4:junit4] 2> 20460 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[58]} 0 5
[junit4:junit4] 2> 20465 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[59 (1429700413711450112)]} 0 0
[junit4:junit4] 2> 20465 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[59 (1429700413711450112)]} 0 0
[junit4:junit4] 2> 20466 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[59 (1429700413711450112)]} 0 3
[junit4:junit4] 2> 20466 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[59]} 0 4
[junit4:junit4] 2> 20471 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[60 (1429700413717741568)]} 0 0
[junit4:junit4] 2> 20471 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[60 (1429700413717741568)]} 0 0
[junit4:junit4] 2> 20472 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[60 (1429700413717741568)]} 0 3
[junit4:junit4] 2> 20472 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[60]} 0 4
[junit4:junit4] 2> 20478 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[61 (1429700413725081600)]} 0 1
[junit4:junit4] 2> 20478 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[61 (1429700413725081600)]} 0 1
[junit4:junit4] 2> 20478 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[61 (1429700413725081600)]} 0 2
[junit4:junit4] 2> 20479 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[61]} 0 5
[junit4:junit4] 2> 20484 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[62 (1429700413731373056)]} 0 0
[junit4:junit4] 2> 20484 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[62 (1429700413731373056)]} 0 0
[junit4:junit4] 2> 20485 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[62 (1429700413731373056)]} 0 3
[junit4:junit4] 2> 20485 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[62]} 0 4
[junit4:junit4] 2> 20490 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[63 (1429700413737664512)]} 0 0
[junit4:junit4] 2> 20490 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[63 (1429700413737664512)]} 0 0
[junit4:junit4] 2> 20491 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[63 (1429700413737664512)]} 0 3
[junit4:junit4] 2> 20492 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[63]} 0 5
[junit4:junit4] 2> 20497 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[64 (1429700413745004544)]} 0 0
[junit4:junit4] 2> 20497 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[64 (1429700413745004544)]} 0 0
[junit4:junit4] 2> 20498 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[64 (1429700413745004544)]} 0 3
[junit4:junit4] 2> 20498 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[64]} 0 5
[junit4:junit4] 2> 20503 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[65 (1429700413751296000)]} 0 0
[junit4:junit4] 2> 20503 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[65 (1429700413751296000)]} 0 0
[junit4:junit4] 2> 20504 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[65 (1429700413751296000)]} 0 3
[junit4:junit4] 2> 20504 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[65]} 0 4
[junit4:junit4] 2> 20510 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[66 (1429700413757587456)]} 0 1
[junit4:junit4] 2> 20510 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[66 (1429700413757587456)]} 0 1
[junit4:junit4] 2> 20510 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[66 (1429700413757587456)]} 0 3
[junit4:junit4] 2> 20511 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[66]} 0 5
[junit4:junit4] 2> 20516 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[67 (1429700413764927488)]} 0 1
[junit4:junit4] 2> 20516 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[67 (1429700413764927488)]} 0 1
[junit4:junit4] 2> 20516 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[67 (1429700413764927488)]} 0 2
[junit4:junit4] 2> 20517 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[67]} 0 5
[junit4:junit4] 2> 20522 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[68 (1429700413771218944)]} 0 0
[junit4:junit4] 2> 20522 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[68 (1429700413771218944)]} 0 0
[junit4:junit4] 2> 20523 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[68 (1429700413771218944)]} 0 3
[junit4:junit4] 2> 20523 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[68]} 0 5
[junit4:junit4] 2> 20529 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[69 (1429700413777510400)]} 0 1
[junit4:junit4] 2> 20529 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[69 (1429700413777510400)]} 0 1
[junit4:junit4] 2> 20529 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[69 (1429700413777510400)]} 0 3
[junit4:junit4] 2> 20530 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[69]} 0 5
[junit4:junit4] 2> 20535 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[70 (1429700413784850432)]} 0 0
[junit4:junit4] 2> 20535 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[70 (1429700413784850432)]} 0 0
[junit4:junit4] 2> 20536 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[70 (1429700413784850432)]} 0 3
[junit4:junit4] 2> 20536 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[70]} 0 5
[junit4:junit4] 2> 20542 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[71 (1429700413792190464)]} 0 1
[junit4:junit4] 2> 20542 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[71 (1429700413792190464)]} 0 1
[junit4:junit4] 2> 20542 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[71 (1429700413792190464)]} 0 2
[junit4:junit4] 2> 20543 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[71]} 0 5
[junit4:junit4] 2> 20548 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[72 (1429700413798481920)]} 0 0
[junit4:junit4] 2> 20549 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[72 (1429700413798481920)]} 0 0
[junit4:junit4] 2> 20551 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[72 (1429700413798481920)]} 0 5
[junit4:junit4] 2> 20552 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[72]} 0 7
[junit4:junit4] 2> 20558 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[73 (1429700413807919104)]} 0 1
[junit4:junit4] 2> 20558 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[73 (1429700413807919104)]} 0 1
[junit4:junit4] 2> 20558 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[73 (1429700413807919104)]} 0 3
[junit4:junit4] 2> 20559 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[73]} 0 5
[junit4:junit4] 2> 20565 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[74 (1429700413815259136)]} 0 1
[junit4:junit4] 2> 20565 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[74 (1429700413815259136)]} 0 1
[junit4:junit4] 2> 20565 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[74 (1429700413815259136)]} 0 3
[junit4:junit4] 2> 20566 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[74]} 0 5
[junit4:junit4] 2> 20571 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[75 (1429700413822599168)]} 0 0
[junit4:junit4] 2> 20571 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[75 (1429700413822599168)]} 0 0
[junit4:junit4] 2> 20572 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[75 (1429700413822599168)]} 0 3
[junit4:junit4] 2> 20573 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[75]} 0 5
[junit4:junit4] 2> 20578 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[76 (1429700413829939200)]} 0 0
[junit4:junit4] 2> 20578 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[76 (1429700413829939200)]} 0 0
[junit4:junit4] 2> 20579 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[76 (1429700413829939200)]} 0 3
[junit4:junit4] 2> 20579 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[76]} 0 5
[junit4:junit4] 2> 20585 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[77 (1429700413837279232)]} 0 1
[junit4:junit4] 2> 20585 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[77 (1429700413837279232)]} 0 1
[junit4:junit4] 2> 20585 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[77 (1429700413837279232)]} 0 2
[junit4:junit4] 2> 20586 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[77]} 0 5
[junit4:junit4] 2> 20591 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[78 (1429700413843570688)]} 0 0
[junit4:junit4] 2> 20591 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[78 (1429700413843570688)]} 0 0
[junit4:junit4] 2> 20592 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[78 (1429700413843570688)]} 0 3
[junit4:junit4] 2> 20592 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[78]} 0 4
[junit4:junit4] 2> 20598 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[79 (1429700413850910720)]} 0 0
[junit4:junit4] 2> 20598 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[79 (1429700413850910720)]} 0 0
[junit4:junit4] 2> 20599 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[79 (1429700413850910720)]} 0 3
[junit4:junit4] 2> 20599 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[79]} 0 5
[junit4:junit4] 2> 20605 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[80 (1429700413858250752)]} 0 1
[junit4:junit4] 2> 20605 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[80 (1429700413858250752)]} 0 1
[junit4:junit4] 2> 20605 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[80 (1429700413858250752)]} 0 2
[junit4:junit4] 2> 20606 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[80]} 0 5
[junit4:junit4] 2> 20611 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[81 (1429700413864542208)]} 0 0
[junit4:junit4] 2> 20612 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[81 (1429700413864542208)]} 0 1
[junit4:junit4] 2> 20612 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[81 (1429700413864542208)]} 0 3
[junit4:junit4] 2> 20613 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[81]} 0 5
[junit4:junit4] 2> 20618 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[82 (1429700413871882240)]} 0 0
[junit4:junit4] 2> 20618 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[82 (1429700413871882240)]} 0 0
[junit4:junit4] 2> 20619 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[82 (1429700413871882240)]} 0 3
[junit4:junit4] 2> 20619 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[82]} 0 5
[junit4:junit4] 2> 20625 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[83 (1429700413879222272)]} 0 0
[junit4:junit4] 2> 20625 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[83 (1429700413879222272)]} 0 0
[junit4:junit4] 2> 20626 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[83 (1429700413879222272)]} 0 3
[junit4:junit4] 2> 20626 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[83]} 0 5
[junit4:junit4] 2> 20631 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[84 (1429700413885513728)]} 0 0
[junit4:junit4] 2> 20632 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[84 (1429700413885513728)]} 0 1
[junit4:junit4] 2> 20632 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[84 (1429700413885513728)]} 0 3
[junit4:junit4] 2> 20633 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[84]} 0 5
[junit4:junit4] 2> 20638 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[85 (1429700413892853760)]} 0 0
[junit4:junit4] 2> 20638 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[85 (1429700413892853760)]} 0 0
[junit4:junit4] 2> 20639 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[85 (1429700413892853760)]} 0 3
[junit4:junit4] 2> 20639 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[85]} 0 5
[junit4:junit4] 2> 20645 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[86 (1429700413899145216)]} 0 1
[junit4:junit4] 2> 20645 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[86 (1429700413899145216)]} 0 1
[junit4:junit4] 2> 20645 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[86 (1429700413899145216)]} 0 3
[junit4:junit4] 2> 20646 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[86]} 0 5
[junit4:junit4] 2> 20651 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[87 (1429700413906485248)]} 0 1
[junit4:junit4] 2> 20651 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[87 (1429700413906485248)]} 0 0
[junit4:junit4] 2> 20652 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[87 (1429700413906485248)]} 0 3
[junit4:junit4] 2> 20652 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[87]} 0 5
[junit4:junit4] 2> 20658 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[88 (1429700413912776704)]} 0 1
[junit4:junit4] 2> 20658 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[88 (1429700413912776704)]} 0 1
[junit4:junit4] 2> 20658 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[88 (1429700413912776704)]} 0 3
[junit4:junit4] 2> 20659 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[88]} 0 5
[junit4:junit4] 2> 20664 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[89 (1429700413920116736)]} 0 0
[junit4:junit4] 2> 20664 T1666 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[89 (1429700413920116736)]} 0 0
[junit4:junit4] 2> 20665 T1640 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[89 (1429700413920116736)]} 0 3
[junit4:junit4] 2> 20666 T1667 C129 P49069 /update {version=2&wt=javabin} {add=[89]} 0 6
[junit4:junit4] 2> 20671 T1652 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[90 (1429700413927456768)]} 0 0
[junit4:junit4] 2> 20671 T1665 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[90 (1429700413927456768)]} 0 0
[junit4:junit4] 2> 20672 T1638 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[90 (1429700413927456768)]} 0 3
[junit4:junit4] 2> 20672 T1668 C129 P49069 /update {version=2&wt=javabin} {add=[90]} 0 5
[junit4:junit4] 2> 20677 T1667 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[91 (1429700413933748224)]} 0 0
[junit4:junit4] 2> 20677 T1653 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[91 (1429700413933748224)]} 0 0
[junit4:junit4] 2> 20678 T1639 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[91 (1429700413933748224)]} 0 3
[junit4:junit4] 2> 20678 T1666 C129 P49069 /update {version=2&wt=javabin} {add=[91]} 0 4
[junit4:junit4] 2> 20684 T1668 C129 P49069 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[92 (1429700413941088256)]} 0 0
[junit4:junit4] 2> 20684 T1651 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadcollection1/&version=2&wt=javabin&update.distrib=FROMLEADER} {add=[92 (1429700413941088256)]} 0 0
[junit4:junit4] 2> 20685 T1637 C128 P51625 /update {distrib.from=http://127.0.0.1:49069/unloadcollection3/&version=2&wt=javabin&update.distrib=TOLEADER} {add=[92 (1429700413941088256)]} 0 3
[junit4:junit4] 2> 20685 T1665 C129 P49069 /update {version=2&wt=javabin} {add=[92]} 0 5
[junit4:junit4] 2> 20691 T1654 C127 P34656 /update {distrib.from=http://127.0.0.1:51625/unloadc
[...truncated too long message...]
49069__multiunload7":{
[junit4:junit4] 1> "node_name":"127.0.0.1:49069_",
[junit4:junit4] 1> "collection":"multiunload",
[junit4:junit4] 1> "state":"recovery_failed",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49069",
[junit4:junit4] 1> "core":"multiunload7"}}}}}}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=897B2C7E7833E7C1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_NI -Dtests.timezone=America/Hermosillo -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 137s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([897B2C7E7833E7C1:89DA2660F6C87FD]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 136722 T1604 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 136736 T1603 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 136751 T1607 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 137779 T1686 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 137779 T1686 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 137780 T1686 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=es_NI, timezone=America/Hermosillo
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=40021800,total=130969600
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestPropInject, TestPostingsSolrHighlighter, SignatureUpdateProcessorFactoryTest, TestLuceneMatchVersion, TestShardHandlerFactory, TestQuerySenderNoQuery, TestMergePolicyConfig, SolrTestCaseJ4Test, StandardRequestHandlerTest, SpellPossibilityIteratorTest, TestRandomFaceting, DateMathParserTest, TestHashPartitioner, TestSuggestSpellingConverter, TestCodecSupport, TestBinaryField, TestUpdate, TestSystemIdResolver, UpdateParamsTest, TimeZoneUtilsTest, TestMultiCoreConfBootstrap, TestLazyCores, TestAnalyzedSuggestions, TestAtomicUpdateErrorCases, SpellCheckCollatorTest, TestRecovery, TestZkChroot, NoCacheHeaderTest, TestRangeQuery, DefaultValueUpdateProcessorTest, TestArbitraryIndexDir, SpellCheckComponentTest, SolrPluginUtilsTest, JSONWriterTest, SuggesterTSTTest, CurrencyFieldOpenExchangeTest, ClusterStateTest, TestFoldingMultitermQuery, ZkSolrClientTest, MultiTermTest, TestStressReorder, DocValuesMultiTest, SimplePostToolTest, ShardRoutingCustomTest, DOMUtilTest, OutputWriterTest, TestDefaultSimilarityFactory, BasicZkTest, TestCollationKeyRangeQueries, TestIndexSearcher, TestRTGBase, OpenExchangeRatesOrgProviderTest, TestCSVLoader, CopyFieldTest, TestDistributedGrouping, IndexBasedSpellCheckerTest, TestLMJelinekMercerSimilarityFactory, TestFiltering, TestOmitPositions, XmlUpdateRequestHandlerTest, DirectSolrSpellCheckerTest, TestReload, IndexSchemaRuntimeFieldTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 138.02s, 1 test, 1 failure <<< FAILURES!
[...truncated 419 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 54 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.6.0_41) - Build # 4705
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4705/
Java: 64bit/jdk1.6.0_41 -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 29654 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:320: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* lucene/benchmark/conf/english-porter-comparison.alg
Total time: 59 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0_41 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure