You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/05 08:44:21 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4546 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4546/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseParallelGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:47491/s_/onenodecollectioncore returned non ok status:404, message:Can not find: /s_/onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:47491/s_/onenodecollectioncore returned non ok status:404, message:Can not find: /s_/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([9A36EBE78C9EAF5:8845E0A60F968AC9]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([9A36EBE78C9EAF5:8845E0A60F968AC9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9165 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4] 2> 0 T482 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /l/
[junit4:junit4] 2> 3 T482 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331
[junit4:junit4] 2> 4 T482 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T483 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T483 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T483 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T483 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 5 T483 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T483 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-1362468690330/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T482 oasc.ZkTestServer.run start zk server on port:48600
[junit4:junit4] 2> 105 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4deb4039
[junit4:junit4] 2> 106 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 106 T488 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T488 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 106 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48360
[junit4:junit4] 2> 107 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48360
[junit4:junit4] 2> 107 T486 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 186 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0000 with negotiated timeout 10000 for client /127.0.0.1:48360
[junit4:junit4] 2> 186 T488 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0000, negotiated timeout = 10000
[junit4:junit4] 2> 187 T489 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4deb4039 name:ZooKeeperConnection Watcher:127.0.0.1:48600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 187 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 187 T482 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 194 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d0000
[junit4:junit4] 2> 195 T489 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 195 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48360 which had sessionid 0x13d3976599d0000
[junit4:junit4] 2> 195 T482 oaz.ZooKeeper.close Session: 0x13d3976599d0000 closed
[junit4:junit4] 2> 196 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@432cb7f4
[junit4:junit4] 2> 197 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 198 T490 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 198 T490 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 198 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48361
[junit4:junit4] 2> 199 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48361
[junit4:junit4] 2> 200 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0001 with negotiated timeout 10000 for client /127.0.0.1:48361
[junit4:junit4] 2> 200 T490 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0001, negotiated timeout = 10000
[junit4:junit4] 2> 201 T491 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@432cb7f4 name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 201 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 202 T482 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 208 T482 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 215 T482 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 220 T482 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 226 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 227 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 238 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 245 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 254 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 254 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 262 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 263 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 268 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 268 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 274 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 274 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 281 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 281 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 287 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 287 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 294 T482 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 295 T482 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 302 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d0001
[junit4:junit4] 2> 303 T491 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 303 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48361 which had sessionid 0x13d3976599d0001
[junit4:junit4] 2> 303 T482 oaz.ZooKeeper.close Session: 0x13d3976599d0001 closed
[junit4:junit4] 2> 367 T482 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 383 T482 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35580
[junit4:junit4] 2> 384 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 384 T482 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 384 T482 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362468690631
[junit4:junit4] 2> 385 T482 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362468690631/solr.xml
[junit4:junit4] 2> 385 T482 oasc.CoreContainer.<init> New CoreContainer 291042516
[junit4:junit4] 2> 385 T482 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362468690631/'
[junit4:junit4] 2> 386 T482 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362468690631/'
[junit4:junit4] 2> 406 T482 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 406 T482 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 406 T482 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 406 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 407 T482 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 407 T482 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 407 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 407 T482 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 408 T482 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 408 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 418 T482 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 425 T482 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:48600/solr
[junit4:junit4] 2> 425 T482 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 426 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@547a4606
[junit4:junit4] 2> 427 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 427 T501 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 427 T501 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 427 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48362
[junit4:junit4] 2> 428 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48362
[junit4:junit4] 2> 429 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0002 with negotiated timeout 20000 for client /127.0.0.1:48362
[junit4:junit4] 2> 429 T501 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0002, negotiated timeout = 20000
[junit4:junit4] 2> 430 T502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@547a4606 name:ZooKeeperConnection Watcher:127.0.0.1:48600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 430 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 432 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d0002
[junit4:junit4] 2> 433 T502 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 433 T482 oaz.ZooKeeper.close Session: 0x13d3976599d0002 closed
[junit4:junit4] 2> 433 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48362 which had sessionid 0x13d3976599d0002
[junit4:junit4] 2> 433 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 436 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@729bc4cb
[junit4:junit4] 2> 437 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 437 T503 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 438 T503 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 438 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48363
[junit4:junit4] 2> 439 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48363
[junit4:junit4] 2> 440 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0003 with negotiated timeout 20000 for client /127.0.0.1:48363
[junit4:junit4] 2> 440 T503 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0003, negotiated timeout = 20000
[junit4:junit4] 2> 441 T504 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@729bc4cb name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 441 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 443 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 447 T482 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 451 T482 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35580_l
[junit4:junit4] 2> 452 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35580_l Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35580_l
[junit4:junit4] 2> 453 T482 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35580_l
[junit4:junit4] 2> 460 T482 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 472 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 474 T482 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 479 T482 oasc.Overseer.start Overseer (id=89290748089663491-127.0.0.1:35580_l-n_0000000000) starting
[junit4:junit4] 2> 481 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 482 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 484 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 486 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 487 T506 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 489 T482 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 494 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 499 T505 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 501 T482 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 502 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 503 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 509 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 510 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@42dd25b2
[junit4:junit4] 2> 512 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 512 T507 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 513 T507 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 513 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48364
[junit4:junit4] 2> 514 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48364
[junit4:junit4] 2> 515 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0004 with negotiated timeout 10000 for client /127.0.0.1:48364
[junit4:junit4] 2> 515 T507 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0004, negotiated timeout = 10000
[junit4:junit4] 2> 515 T508 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42dd25b2 name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 516 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 518 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 522 T482 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 586 T482 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 588 T482 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38060
[junit4:junit4] 2> 589 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 589 T482 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 589 T482 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849
[junit4:junit4] 2> 590 T482 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/solr.xml
[junit4:junit4] 2> 590 T482 oasc.CoreContainer.<init> New CoreContainer 1067122245
[junit4:junit4] 2> 590 T482 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/'
[junit4:junit4] 2> 590 T482 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/'
[junit4:junit4] 2> 605 T482 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 606 T482 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 606 T482 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 606 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 607 T482 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 607 T482 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 607 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 607 T482 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 608 T482 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 608 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 613 T482 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 620 T482 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:48600/solr
[junit4:junit4] 2> 620 T482 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 621 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@eb4bdf6
[junit4:junit4] 2> 622 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 622 T518 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 623 T518 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 623 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48365
[junit4:junit4] 2> 623 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48365
[junit4:junit4] 2> 625 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0005 with negotiated timeout 20000 for client /127.0.0.1:48365
[junit4:junit4] 2> 625 T518 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0005, negotiated timeout = 20000
[junit4:junit4] 2> 625 T519 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eb4bdf6 name:ZooKeeperConnection Watcher:127.0.0.1:48600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 626 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 628 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d0005
[junit4:junit4] 2> 629 T519 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 629 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48365 which had sessionid 0x13d3976599d0005
[junit4:junit4] 2> 629 T482 oaz.ZooKeeper.close Session: 0x13d3976599d0005 closed
[junit4:junit4] 2> 629 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 632 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a8ae45b
[junit4:junit4] 2> 633 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 633 T520 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 634 T520 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 634 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48366
[junit4:junit4] 2> 635 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48366
[junit4:junit4] 2> 636 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0006 with negotiated timeout 20000 for client /127.0.0.1:48366
[junit4:junit4] 2> 636 T520 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0006, negotiated timeout = 20000
[junit4:junit4] 2> 637 T521 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a8ae45b name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 637 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 638 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:create cxid:0x1 zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 640 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:create cxid:0x2 zxid:0x2e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 643 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1648 T482 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38060_l
[junit4:junit4] 2> 1650 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:delete cxid:0x9 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38060_l Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38060_l
[junit4:junit4] 2> 1652 T482 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38060_l
[junit4:junit4] 2> 1659 T504 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1659 T521 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1659 T508 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1670 T482 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1670 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1671 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1748 T482 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1751 T482 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35744
[junit4:junit4] 2> 1752 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1752 T482 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1752 T482 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004
[junit4:junit4] 2> 1753 T482 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/solr.xml
[junit4:junit4] 2> 1753 T482 oasc.CoreContainer.<init> New CoreContainer 315697909
[junit4:junit4] 2> 1754 T482 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/'
[junit4:junit4] 2> 1754 T482 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/'
[junit4:junit4] 2> 1782 T482 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1782 T482 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1783 T482 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1783 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1784 T482 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1785 T482 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1785 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1786 T482 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1786 T482 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1787 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1793 T482 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1800 T482 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:48600/solr
[junit4:junit4] 2> 1801 T482 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1801 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@fcc697f
[junit4:junit4] 2> 1802 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1802 T531 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1803 T531 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 1803 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48367
[junit4:junit4] 2> 1804 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48367
[junit4:junit4] 2> 1805 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0007 with negotiated timeout 20000 for client /127.0.0.1:48367
[junit4:junit4] 2> 1805 T531 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0007, negotiated timeout = 20000
[junit4:junit4] 2> 1805 T532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fcc697f name:ZooKeeperConnection Watcher:127.0.0.1:48600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1806 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1808 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d0007
[junit4:junit4] 2> 1809 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48367 which had sessionid 0x13d3976599d0007
[junit4:junit4] 2> 1809 T532 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1809 T482 oaz.ZooKeeper.close Session: 0x13d3976599d0007 closed
[junit4:junit4] 2> 1809 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1812 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@875c04d
[junit4:junit4] 2> 1813 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1813 T533 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1814 T533 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 1814 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48368
[junit4:junit4] 2> 1814 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48368
[junit4:junit4] 2> 1816 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0008 with negotiated timeout 20000 for client /127.0.0.1:48368
[junit4:junit4] 2> 1816 T533 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0008, negotiated timeout = 20000
[junit4:junit4] 2> 1816 T534 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@875c04d name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1816 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1817 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0008 type:create cxid:0x1 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1819 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0008 type:create cxid:0x2 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1821 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2826 T482 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35744_l
[junit4:junit4] 2> 2827 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0008 type:delete cxid:0x9 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35744_l Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35744_l
[junit4:junit4] 2> 2829 T482 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35744_l
[junit4:junit4] 2> 2835 T504 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2836 T521 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2836 T534 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2836 T508 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2846 T482 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 2847 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2847 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2909 T482 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 2912 T482 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55209
[junit4:junit4] 2> 2913 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2914 T482 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2915 T482 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180
[junit4:junit4] 2> 2915 T482 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/solr.xml
[junit4:junit4] 2> 2916 T482 oasc.CoreContainer.<init> New CoreContainer 1130097945
[junit4:junit4] 2> 2916 T482 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/'
[junit4:junit4] 2> 2917 T482 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/'
[junit4:junit4] 2> 2937 T482 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2937 T482 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2938 T482 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2938 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2938 T482 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2939 T482 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2939 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2939 T482 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2939 T482 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2940 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2945 T482 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2952 T482 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:48600/solr
[junit4:junit4] 2> 2952 T482 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2953 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@687c3c5
[junit4:junit4] 2> 2954 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2954 T544 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2955 T544 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 2955 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48369
[junit4:junit4] 2> 2956 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48369
[junit4:junit4] 2> 2957 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d0009 with negotiated timeout 20000 for client /127.0.0.1:48369
[junit4:junit4] 2> 2957 T544 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d0009, negotiated timeout = 20000
[junit4:junit4] 2> 2958 T545 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@687c3c5 name:ZooKeeperConnection Watcher:127.0.0.1:48600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2958 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2960 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d0009
[junit4:junit4] 2> 2961 T545 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2961 T482 oaz.ZooKeeper.close Session: 0x13d3976599d0009 closed
[junit4:junit4] 2> 2961 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48369 which had sessionid 0x13d3976599d0009
[junit4:junit4] 2> 2961 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2964 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@42f6663e
[junit4:junit4] 2> 2976 T546 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2965 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2977 T546 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 2977 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48370
[junit4:junit4] 2> 2978 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48370
[junit4:junit4] 2> 2980 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d000a with negotiated timeout 20000 for client /127.0.0.1:48370
[junit4:junit4] 2> 2980 T546 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d000a, negotiated timeout = 20000
[junit4:junit4] 2> 2980 T547 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42f6663e name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2980 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2982 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d000a type:create cxid:0x1 zxid:0x3d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2983 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d000a type:create cxid:0x2 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2986 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3991 T482 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55209_l
[junit4:junit4] 2> 3993 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d000a type:delete cxid:0x9 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55209_l Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55209_l
[junit4:junit4] 2> 3994 T482 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55209_l
[junit4:junit4] 2> 4001 T504 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4001 T521 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4001 T534 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4001 T508 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4002 T547 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4012 T482 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4012 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4013 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4070 T482 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4073 T482 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46373
[junit4:junit4] 2> 4074 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4074 T482 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4074 T482 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362468694346
[junit4:junit4] 2> 4075 T482 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362468694346/solr.xml
[junit4:junit4] 2> 4075 T482 oasc.CoreContainer.<init> New CoreContainer 483619893
[junit4:junit4] 2> 4075 T482 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362468694346/'
[junit4:junit4] 2> 4076 T482 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362468694346/'
[junit4:junit4] 2> 4090 T482 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4090 T482 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4090 T482 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4091 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4091 T482 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4091 T482 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4091 T482 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4092 T482 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4092 T482 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4092 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4097 T482 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4104 T482 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:48600/solr
[junit4:junit4] 2> 4104 T482 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4105 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e395e32
[junit4:junit4] 2> 4106 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4106 T557 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4107 T557 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 4107 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48372
[junit4:junit4] 2> 4108 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48372
[junit4:junit4] 2> 4109 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d000b with negotiated timeout 20000 for client /127.0.0.1:48372
[junit4:junit4] 2> 4109 T557 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d000b, negotiated timeout = 20000
[junit4:junit4] 2> 4110 T558 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e395e32 name:ZooKeeperConnection Watcher:127.0.0.1:48600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4110 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4112 T487 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3976599d000b
[junit4:junit4] 2> 4112 T484 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48372 which had sessionid 0x13d3976599d000b
[junit4:junit4] 2> 4112 T482 oaz.ZooKeeper.close Session: 0x13d3976599d000b closed
[junit4:junit4] 2> 4112 T558 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4113 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4115 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f35f5db
[junit4:junit4] 2> 4116 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4117 T559 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4117 T559 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 4117 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48373
[junit4:junit4] 2> 4118 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48373
[junit4:junit4] 2> 4119 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d000c with negotiated timeout 20000 for client /127.0.0.1:48373
[junit4:junit4] 2> 4119 T559 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d000c, negotiated timeout = 20000
[junit4:junit4] 2> 4119 T560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f35f5db name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4119 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4120 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d000c type:create cxid:0x1 zxid:0x45 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4122 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d000c type:create cxid:0x2 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4124 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5129 T482 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46373_l
[junit4:junit4] 2> 5130 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d000c type:delete cxid:0x9 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46373_l Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46373_l
[junit4:junit4] 2> 5132 T482 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46373_l
[junit4:junit4] 2> 5138 T504 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5139 T521 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5139 T508 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5139 T534 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5139 T560 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5139 T547 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5149 T482 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 5150 T482 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5150 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5156 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5170 T517 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/unloadcollection1
[junit4:junit4] 2> 5171 T517 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 5172 T517 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4] 2> 5173 T517 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 5176 T517 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 5176 T517 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4] 2> 5182 T517 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 5185 T517 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/unloadcollection1/'
[junit4:junit4] 2> 5224 T517 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 5248 T517 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5249 T517 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5253 T517 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5500 T517 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5505 T517 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5507 T517 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5534 T517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5541 T517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5547 T517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5549 T517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5551 T517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5552 T517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5554 T517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5555 T517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5555 T517 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/
[junit4:junit4] 2> 5557 T517 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fe2c08
[junit4:junit4] 2> 5558 T517 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5559 T517 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n forceNew:false
[junit4:junit4] 2> 5559 T517 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 5560 T517 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index/
[junit4:junit4] 2> 5560 T517 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5563 T517 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index forceNew:false
[junit4:junit4] 2> 5568 T517 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5569 T517 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5570 T517 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index
[junit4:junit4] 2> 5572 T517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5573 T517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5574 T517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5574 T517 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5575 T517 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5576 T517 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5576 T517 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5577 T517 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5578 T517 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5582 T517 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5585 T517 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 5586 T517 oass.SolrIndexSearcher.<init> Opening Searcher@23034192 main
[junit4:junit4] 2> 5586 T517 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/tlog
[junit4:junit4] 2> 5586 T517 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5587 T517 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5590 T517 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 5591 T561 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@23034192 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5593 T517 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4] 2> 5594 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:create cxid:0x3e zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 6520 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6522 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38060/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:38060_l"}
[junit4:junit4] 2> 6522 T505 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4] 2> 6522 T505 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6523 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0003 type:create cxid:0x41 zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 6534 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6535 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6535 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6535 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6535 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6535 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6599 T517 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4] 2> 6600 T517 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:38060/l collection:unloadcollection shard:shard1
[junit4:junit4] 2> 6601 T517 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 2> 6618 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:delete cxid:0x4f zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4] 2> 6619 T517 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6620 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:create cxid:0x50 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6625 T517 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6626 T517 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6626 T517 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38060/l/unloadcollection1/
[junit4:junit4] 2> 6626 T517 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6626 T517 oasc.SyncStrategy.syncToMe http://127.0.0.1:38060/l/unloadcollection1/ has no replicas
[junit4:junit4] 2> 6627 T517 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38060/l/unloadcollection1/
[junit4:junit4] 2> 6627 T517 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4] 2> 6634 T487 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3976599d0006 type:create cxid:0x5a zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8046 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8063 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8063 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8063 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8063 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8063 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8063 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8091 T517 oasc.ZkController.register We are http://127.0.0.1:38060/l/unloadcollection1/ and leader is http://127.0.0.1:38060/l/unloadcollection1/
[junit4:junit4] 2> 8092 T517 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:38060/l
[junit4:junit4] 2> 8092 T517 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8093 T517 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4] 2> 8097 T517 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8098 T517 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/solr.xml
[junit4:junit4] 2> 8110 T517 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362468690849/solr.xml
[junit4:junit4] 2> 8115 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 8116 T482 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48600/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ca8d992
[junit4:junit4] 2> 8117 T482 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8117 T562 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48600. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8118 T562 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48600, initiating session
[junit4:junit4] 2> 8118 T484 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48376
[junit4:junit4] 2> 8119 T484 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48376
[junit4:junit4] 2> 8121 T486 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3976599d000d with negotiated timeout 10000 for client /127.0.0.1:48376
[junit4:junit4] 2> 8121 T562 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48600, sessionid = 0x13d3976599d000d, negotiated timeout = 10000
[junit4:junit4] 2> 8121 T563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ca8d992 name:ZooKeeperConnection Watcher:127.0.0.1:48600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8122 T482 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8123 T482 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8126 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8128 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8136 T530 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/unloadcollection2
[junit4:junit4] 2> 8137 T530 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 8138 T530 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 8139 T530 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 8141 T530 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/unloadcollection2/'
[junit4:junit4] 2> 8185 T530 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 8236 T530 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 8237 T530 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 8241 T530 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8500 T530 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8505 T530 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8507 T530 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8531 T530 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8535 T530 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8539 T530 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8541 T530 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8544 T530 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8544 T530 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8547 T530 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8547 T530 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8548 T530 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/
[junit4:junit4] 2> 8548 T530 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fe2c08
[junit4:junit4] 2> 8549 T530 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8550 T530 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n forceNew:false
[junit4:junit4] 2> 8550 T530 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 8551 T530 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index/
[junit4:junit4] 2> 8551 T530 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8553 T530 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index forceNew:false
[junit4:junit4] 2> 8565 T530 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660308tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@e968b0b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8566 T530 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8566 T530 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index
[junit4:junit4] 2> 8568 T530 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8569 T530 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8570 T530 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8570 T530 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8571 T530 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8571 T530 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8571 T530 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8572 T530 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8573 T530 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8576 T530 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8579 T530 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 8580 T530 oass.SolrIndexSearcher.<init> Opening Searcher@356a2376 main
[junit4:junit4] 2> 8580 T530 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/tlog
[junit4:junit4] 2> 8581 T530 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8582 T530 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8585 T530 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 8587 T564 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@356a2376 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8588 T530 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4] 2> 8589 T530 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9578 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9579 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38060/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:38060_l"}
[junit4:junit4] 2> 9588 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35744/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:35744_l"}
[junit4:junit4] 2> 9588 T505 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 9588 T505 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9597 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9597 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9597 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9598 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9597 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9597 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9597 T563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10591 T530 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4] 2> 10592 T530 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:35744/l collection:unloadcollection shard:shard1
[junit4:junit4] 2> 10599 T530 oasc.ZkController.register We are http://127.0.0.1:35744/l/unloadcollection2/ and leader is http://127.0.0.1:38060/l/unloadcollection1/
[junit4:junit4] 2> 10600 T530 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:35744/l
[junit4:junit4] 2> 10600 T530 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4] 2> 10601 T530 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C19 name=unloadcollection2 org.apache.solr.core.SolrCore@45e65147 url=http://127.0.0.1:35744/l/unloadcollection2 node=127.0.0.1:35744_l C19_STATE=coll:unloadcollection core:unloadcollection2 props:{state=down, core=unloadcollection2, base_url=http://127.0.0.1:35744/l, collection=unloadcollection, node_name=127.0.0.1:35744_l}
[junit4:junit4] 2> 10607 T565 C19 P35744 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4] 2> 10608 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 10609 T530 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10609 T565 C19 P35744 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4] 2> 10609 T565 C19 P35744 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10610 T530 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/solr.xml
[junit4:junit4] 2> 10612 T565 C19 P35744 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10620 T530 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362468692004/solr.xml
[junit4:junit4] 2> 10624 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10626 T482 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 10628 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11113 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11115 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35744/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:35744_l"}
[junit4:junit4] 2> 11134 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11134 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11135 T563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11135 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11135 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11135 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11134 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11632 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12635 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C19_STATE=coll:unloadcollection core:unloadcollection2 props:{shard=shard1, state=recovering, core=unloadcollection2, base_url=http://127.0.0.1:35744/l, collection=unloadcollection, node_name=127.0.0.1:35744_l}
[junit4:junit4] 2> 13624 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38060/l/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4] 2> 13630 T565 C19 P35744 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 13638 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13640 T565 C19 P35744 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:35744/l START replicas=[http://127.0.0.1:38060/l/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 13644 T565 C19 P35744 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 13645 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4] 2> 13645 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4] 2> 13645 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4] 2> 13645 T565 C19 P35744 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 13645 T565 C19 P35744 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38060/l/unloadcollection1/. core=unloadcollection2
[junit4:junit4] 2> 13645 T565 C19 P35744 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C20 name=unloadcollection1 org.apache.solr.core.SolrCore@37223c18 url=http://127.0.0.1:38060/l/unloadcollection1 node=127.0.0.1:38060_l C20_STATE=coll:unloadcollection core:unloadcollection1 props:{shard=shard1, state=active, core=unloadcollection1, base_url=http://127.0.0.1:38060/l, collection=unloadcollection, node_name=127.0.0.1:38060_l, leader=true}
[junit4:junit4] 2> 13652 T514 C20 P38060 REQ /get {wt=javabin&qt=/get&getVersions=100&version=2&distrib=false} status=0 QTime=1
[junit4:junit4] 2> 13664 T517 C20 P38060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 13664 T517 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 13667 T517 C20 P38060 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13668 T517 C20 P38060 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13674 T517 C20 P38060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13674 T517 C20 P38060 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13675 T517 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 13676 T517 C20 P38060 oass.SolrIndexSearcher.<init> Opening Searcher@59f4f3af realtime
[junit4:junit4] 2> 13676 T517 C20 P38060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 13677 T517 C20 P38060 /update {wt=javabin&openSearcher=false&waitSearcher=true&commit=true&softCommit=false&commit_end_point=true&version=2} {commit=} 0 21
[junit4:junit4] 2> 13678 T565 C19 P35744 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13679 T565 C19 P35744 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 13689 T565 C19 P35744 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 13707 T516 C20 P38060 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13707 T516 C20 P38060 REQ /replication {wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=15
[junit4:junit4] 2> 13709 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 13709 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 13710 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 13713 T514 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 13714 T514 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index
[junit4:junit4] 2> 13715 T514 C20 P38060 REQ /replication {wt=javabin&qt=/replication&generation=2&version=2&command=filelist} status=0 QTime=2
[junit4:junit4] 2> 13716 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 13718 T565 C19 P35744 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index.20130305013144044 forceNew:false
[junit4:junit4] 2> 13719 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 13719 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@650dd89a lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fd9e54)) fullCopy=false
[junit4:junit4] 2> 13728 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=2&file=segments_2&checksum=true&command=filecontent} status=0 QTime=3
[junit4:junit4] 2> 13736 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index
[junit4:junit4] 2> 13736 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 13737 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 13753 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 13754 T565 C19 P35744 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 13754 T565 C19 P35744 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4] 2> 13755 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 13760 T565 C19 P35744 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660308tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@e968b0b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660308tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@e968b0b),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13761 T565 C19 P35744 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13761 T565 C19 P35744 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 13762 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 13762 T565 C19 P35744 oass.SolrIndexSearcher.<init> Opening Searcher@4fed12d4 main
[junit4:junit4] 2> 13764 T564 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@4fed12d4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 13765 T564 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index
[junit4:junit4] 2> 13765 T565 C19 P35744 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@650dd89a lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fd9e54))
[junit4:junit4] 2> 13765 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index.20130305013144044
[junit4:junit4] 2> 13765 T565 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index
[junit4:junit4] 2> 13765 T565 C19 P35744 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4] 2> 13766 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4] 2> 13766 T565 C19 P35744 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4] 2> 13766 T565 C19 P35744 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13768 T565 C19 P35744 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4] 2> 14150 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14152 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35744/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:35744_l"}
[junit4:junit4] 2> 14162 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14162 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14162 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14162 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14162 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14162 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14162 T563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14642 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14644 T482 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 14644 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C19_STATE=coll:unloadcollection core:unloadcollection2 props:{shard=shard1, state=active, core=unloadcollection2, base_url=http://127.0.0.1:35744/l, collection=unloadcollection, node_name=127.0.0.1:35744_l}
[junit4:junit4] 2> 14681 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[6 (1428651984800448512)]} 0 2
[junit4:junit4] 2> 14682 T517 C20 P38060 /update {wt=javabin&version=2} {add=[6 (1428651984800448512)]} 0 28
[junit4:junit4] 2> 14690 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[7 (1428651984826662912)]} 0 1
[junit4:junit4] 2> 14691 T515 C20 P38060 /update {wt=javabin&version=2} {add=[7 (1428651984826662912)]} 0 6
[junit4:junit4] 2> 14698 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[8 (1428651984836100096)]} 0 1
[junit4:junit4] 2> 14699 T516 C20 P38060 /update {wt=javabin&version=2} {add=[8 (1428651984836100096)]} 0 5
[junit4:junit4] 2> 14702 T514 C20 P38060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14744 T514 C20 P38060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_3,generation=3,filenames=[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, segments_3, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc]
[junit4:junit4] 2> 14745 T514 C20 P38060 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, segments_3, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc]
[junit4:junit4] 2> 14746 T514 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 14753 T514 C20 P38060 oass.SolrIndexSearcher.<init> Opening Searcher@4d1d8f77 main
[junit4:junit4] 2> 14753 T514 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index
[junit4:junit4] 2> 14755 T514 C20 P38060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14755 T561 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@4d1d8f77 main{StandardDirectoryReader(segments_3:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 14756 T561 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index
[junit4:junit4] 2> 14757 T514 C20 P38060 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35744/l/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 14761 T527 C19 P35744 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14794 T527 C19 P35744 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660308tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@e968b0b),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660308tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@e968b0b),segFN=segments_3,generation=3,filenames=[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, segments_3, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc]
[junit4:junit4] 2> 14794 T527 C19 P35744 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, segments_3, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc]
[junit4:junit4] 2> 14795 T527 C19 P35744 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n
[junit4:junit4] 2> 14803 T527 C19 P35744 oass.SolrIndexSearcher.<init> Opening Searcher@6f62ebc7 main
[junit4:junit4] 2> 14803 T527 C19 P35744 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14804 T564 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@6f62ebc7 main{StandardDirectoryReader(segments_3:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 14805 T564 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468698460unloadcollection1_2n/index
[junit4:junit4] 2> 14805 T527 C19 P35744 /update {expungeDeletes=false&wt=javabin&waitSearcher=true&commit=true&softCommit=false&commit_end_point=true&version=2} {commit=} 0 44
[junit4:junit4] 2> 14806 T514 C20 P38060 /update {wt=javabin&waitSearcher=true&commit=true&softCommit=false&version=2} {commit=} 0 104
[junit4:junit4] 2> 14808 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14818 T543 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/unloadcollection3
[junit4:junit4] 2> 14818 T543 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 14820 T543 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14820 T543 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 14823 T543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/unloadcollection3/'
[junit4:junit4] 2> 14867 T543 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 14890 T543 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14891 T543 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14895 T543 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15148 T543 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15153 T543 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15155 T543 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15180 T543 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15185 T543 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15190 T543 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15193 T543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15194 T543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15194 T543 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15197 T543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15197 T543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15198 T543 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/
[junit4:junit4] 2> 15198 T543 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fe2c08
[junit4:junit4] 2> 15199 T543 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15200 T543 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n forceNew:false
[junit4:junit4] 2> 15200 T543 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 15200 T543 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index/
[junit4:junit4] 2> 15201 T543 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15202 T543 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index forceNew:false
[junit4:junit4] 2> 15207 T543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660309tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4040842f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15208 T543 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15209 T543 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index
[junit4:junit4] 2> 15211 T543 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15212 T543 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15213 T543 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15213 T543 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15214 T543 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15215 T543 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15215 T543 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15216 T543 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15217 T543 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15221 T543 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15225 T543 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 15226 T543 oass.SolrIndexSearcher.<init> Opening Searcher@43e458bb main
[junit4:junit4] 2> 15227 T543 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/tlog
[junit4:junit4] 2> 15228 T543 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15228 T543 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15234 T543 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 15235 T569 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@43e458bb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15237 T543 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4] 2> 15237 T543 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15674 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15676 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55209/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55209_l"}
[junit4:junit4] 2> 15676 T505 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 15676 T505 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15686 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15686 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15686 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15686 T563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15686 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15686 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15686 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16240 T543 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4] 2> 16240 T543 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:55209/l collection:unloadcollection shard:shard1
[junit4:junit4] 2> 16247 T543 oasc.ZkController.register We are http://127.0.0.1:55209/l/unloadcollection3/ and leader is http://127.0.0.1:38060/l/unloadcollection1/
[junit4:junit4] 2> 16248 T543 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:55209/l
[junit4:junit4] 2> 16248 T543 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4] 2> 16248 T543 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C21 name=unloadcollection3 org.apache.solr.core.SolrCore@567ba40f url=http://127.0.0.1:55209/l/unloadcollection3 node=127.0.0.1:55209_l C21_STATE=coll:unloadcollection core:unloadcollection3 props:{state=down, core=unloadcollection3, base_url=http://127.0.0.1:55209/l, collection=unloadcollection, node_name=127.0.0.1:55209_l}
[junit4:junit4] 2> 16250 T570 C21 P55209 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4] 2> 16250 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16251 T570 C21 P55209 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4] 2> 16251 T570 C21 P55209 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16251 T543 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16253 T570 C21 P55209 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16253 T543 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/solr.xml
[junit4:junit4] 2> 16263 T543 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362468693180/solr.xml
[junit4:junit4] 2> 16266 T482 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 16267 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17195 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17197 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55209/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55209_l"}
[junit4:junit4] 2> 17206 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17206 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17206 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17206 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17206 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17206 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17206 T563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17271 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18274 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C21_STATE=coll:unloadcollection core:unloadcollection3 props:{shard=shard1, state=recovering, core=unloadcollection3, base_url=http://127.0.0.1:55209/l, collection=unloadcollection, node_name=127.0.0.1:55209_l}
[junit4:junit4] 2> 19266 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38060/l/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4] 2> 19266 T570 C21 P55209 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:55209/l START replicas=[http://127.0.0.1:38060/l/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 19267 T570 C21 P55209 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19267 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4] 2> 19267 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4] 2> 19267 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4] 2> 19268 T570 C21 P55209 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19268 T570 C21 P55209 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38060/l/unloadcollection1/. core=unloadcollection3
[junit4:junit4] 2> 19268 T570 C21 P55209 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19275 T516 C20 P38060 REQ /get {wt=javabin&qt=/get&getVersions=100&version=2&distrib=false} status=0 QTime=5
[junit4:junit4] 2> 19278 T517 C20 P38060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19278 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19294 T517 C20 P38060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_3,generation=3,filenames=[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, segments_3, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660307tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@50935935),segFN=segments_4,generation=4,filenames=[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc, segments_4]
[junit4:junit4] 2> 19295 T517 C20 P38060 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0.si, _0_Pulsing41_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_Asserting_0.tim, _0_Memory_0.ram, _0.nvd, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc, segments_4]
[junit4:junit4] 2> 19296 T517 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 19296 T517 C20 P38060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19297 T517 C20 P38060 /update {wt=javabin&openSearcher=false&waitSearcher=true&commit=true&softCommit=false&commit_end_point=true&version=2} {commit=} 0 19
[junit4:junit4] 2> 19298 T570 C21 P55209 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19298 T570 C21 P55209 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19303 T515 C20 P38060 REQ /replication {wt=javabin&qt=/replication&version=2&command=indexversion} status=0 QTime=1
[junit4:junit4] 2> 19304 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 19305 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19305 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19308 T516 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n
[junit4:junit4] 2> 19310 T516 C20 P38060 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468695492unloadcollection1_1n/index
[junit4:junit4] 2> 19311 T516 C20 P38060 REQ /replication {wt=javabin&qt=/replication&generation=4&version=2&command=filelist} status=0 QTime=3
[junit4:junit4] 2> 19312 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 21
[junit4:junit4] 2> 19314 T570 C21 P55209 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index.20130305013149640 forceNew:false
[junit4:junit4] 2> 19314 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 19317 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77d9fc37 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12e9a163)) fullCopy=false
[junit4:junit4] 2> 19320 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Asserting_0.doc&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19326 T514 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0.fdt&checksum=true&command=filecontent} status=0 QTime=1
[junit4:junit4] 2> 19331 T515 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Pulsing41_0.tim&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19336 T516 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Asserting_0.pos&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19341 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0.nvm&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19346 T514 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Pulsing41_0.tip&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19349 T515 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_TestBloomFilteredLucene41Postings_0.blm&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19353 T516 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_TestBloomFilteredLucene41Postings_0.pos&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19357 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0.fnm&checksum=true&command=filecontent} status=0 QTime=1
[junit4:junit4] 2> 19360 T514 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Asserting_0.tip&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19363 T515 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Asserting_0.tim&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19367 T516 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_TestBloomFilteredLucene41Postings_0.tip&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19370 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Pulsing41_0.doc&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19374 T514 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0.si&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19377 T515 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Memory_0.ram&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19381 T516 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0.nvd&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19384 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_Pulsing41_0.pos&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19388 T514 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_TestBloomFilteredLucene41Postings_0.tim&checksum=true&command=filecontent} status=0 QTime=1
[junit4:junit4] 2> 19391 T515 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0.fdx&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19394 T516 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=segments_4&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19398 T517 C20 P38060 REQ /replication {wt=filestream&qt=/replication&generation=4&file=_0_TestBloomFilteredLucene41Postings_0.doc&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19399 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index
[junit4:junit4] 2> 19399 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19402 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 19403 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 19403 T570 C21 P55209 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19403 T570 C21 P55209 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4] 2> 19403 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 19406 T570 C21 P55209 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660309tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4040842f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/index6029660309tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4040842f),segFN=segments_4,generation=4,filenames=[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0_Asserting_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0.si, _0_Pulsing41_0.doc, _0_Memory_0.ram, _0.nvd, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc, segments_4]
[junit4:junit4] 2> 19406 T570 C21 P55209 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.fdt, _0_Asserting_0.doc, _0_Pulsing41_0.tim, _0.nvm, _0_Asserting_0.pos, _0_Pulsing41_0.tip, _0_TestBloomFilteredLucene41Postings_0.blm, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Asserting_0.tip, _0_Asserting_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0.si, _0_Pulsing41_0.doc, _0_Memory_0.ram, _0.nvd, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.tim, _0.fdx, _0_TestBloomFilteredLucene41Postings_0.doc, segments_4]
[junit4:junit4] 2> 19407 T570 C21 P55209 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19407 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n
[junit4:junit4] 2> 19410 T570 C21 P55209 oass.SolrIndexSearcher.<init> Opening Searcher@15a2a6b6 main
[junit4:junit4] 2> 19411 T569 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@15a2a6b6 main{StandardDirectoryReader(segments_4:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 19411 T569 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index
[junit4:junit4] 2> 19411 T570 C21 P55209 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77d9fc37 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12e9a163))
[junit4:junit4] 2> 19412 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index.20130305013149640
[junit4:junit4] 2> 19412 T570 C21 P55209 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362468690331/1362468705142unloadcollection_3n/index
[junit4:junit4] 2> 19412 T570 C21 P55209 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4] 2> 19412 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4] 2> 19412 T570 C21 P55209 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4] 2> 19412 T570 C21 P55209 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19414 T570 C21 P55209 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4] 2> 20231 T505 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20233 T505 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55209/l",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55209_l"}
[junit4:junit4] 2> 20254 T504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20254 T508 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20255 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20255 T563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20255 T547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20255 T560 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20254 T534 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20282 T482 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20284 T482 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 20284 T482 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20322 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[20 (1428651990721757184)]} 0 6
[junit4:junit4] 2> C21_STATE=coll:unloadcollection core:unloadcollection3 props:{shard=shard1, state=active, core=unloadcollection3, base_url=http://127.0.0.1:55209/l, collection=unloadcollection, node_name=127.0.0.1:55209_l}
[junit4:junit4] 2> 20322 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[20 (1428651990721757184)]} 0 6
[junit4:junit4] 2> 20323 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[20 (1428651990721757184)]} 0 17
[junit4:junit4] 2> 20325 T540 C21 P55209 /update {wt=javabin&version=2} {add=[20]} 0 25
[junit4:junit4] 2> 20342 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[21 (1428651990749020160)]} 0 3
[junit4:junit4] 2> 20343 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[21 (1428651990749020160)]} 0 4
[junit4:junit4] 2> 20344 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[21 (1428651990749020160)]} 0 11
[junit4:junit4] 2> 20345 T541 C21 P55209 /update {wt=javabin&version=2} {add=[21]} 0 16
[junit4:junit4] 2> 20355 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[22 (1428651990767894528)]} 0 1
[junit4:junit4] 2> 20355 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[22 (1428651990767894528)]} 0 1
[junit4:junit4] 2> 20356 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[22 (1428651990767894528)]} 0 6
[junit4:junit4] 2> 20357 T542 C21 P55209 /update {wt=javabin&version=2} {add=[22]} 0 9
[junit4:junit4] 2> 20367 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[23 (1428651990779428864)]} 0 1
[junit4:junit4] 2> 20367 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[23 (1428651990779428864)]} 0 1
[junit4:junit4] 2> 20368 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[23 (1428651990779428864)]} 0 6
[junit4:junit4] 2> 20369 T543 C21 P55209 /update {wt=javabin&version=2} {add=[23]} 0 10
[junit4:junit4] 2> 20379 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[24 (1428651990792011776)]} 0 1
[junit4:junit4] 2> 20379 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[24 (1428651990792011776)]} 0 1
[junit4:junit4] 2> 20379 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[24 (1428651990792011776)]} 0 5
[junit4:junit4] 2> 20380 T540 C21 P55209 /update {wt=javabin&version=2} {add=[24]} 0 9
[junit4:junit4] 2> 20389 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[25 (1428651990803546112)]} 0 1
[junit4:junit4] 2> 20389 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[25 (1428651990803546112)]} 0 1
[junit4:junit4] 2> 20390 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[25 (1428651990803546112)]} 0 5
[junit4:junit4] 2> 20391 T541 C21 P55209 /update {wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 20400 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[26 (1428651990815080448)]} 0 1
[junit4:junit4] 2> 20400 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[26 (1428651990815080448)]} 0 1
[junit4:junit4] 2> 20401 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[26 (1428651990815080448)]} 0 5
[junit4:junit4] 2> 20402 T542 C21 P55209 /update {wt=javabin&version=2} {add=[26]} 0 9
[junit4:junit4] 2> 20411 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[27 (1428651990826614784)]} 0 1
[junit4:junit4] 2> 20411 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[27 (1428651990826614784)]} 0 1
[junit4:junit4] 2> 20412 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[27 (1428651990826614784)]} 0 5
[junit4:junit4] 2> 20412 T543 C21 P55209 /update {wt=javabin&version=2} {add=[27]} 0 8
[junit4:junit4] 2> 20422 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[28 (1428651990838149120)]} 0 1
[junit4:junit4] 2> 20422 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[28 (1428651990838149120)]} 0 1
[junit4:junit4] 2> 20423 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[28 (1428651990838149120)]} 0 6
[junit4:junit4] 2> 20424 T540 C21 P55209 /update {wt=javabin&version=2} {add=[28]} 0 9
[junit4:junit4] 2> 20433 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[29 (1428651990849683456)]} 0 1
[junit4:junit4] 2> 20433 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[29 (1428651990849683456)]} 0 1
[junit4:junit4] 2> 20434 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[29 (1428651990849683456)]} 0 5
[junit4:junit4] 2> 20434 T541 C21 P55209 /update {wt=javabin&version=2} {add=[29]} 0 8
[junit4:junit4] 2> 20445 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[30 (1428651990861217792)]} 0 2
[junit4:junit4] 2> 20445 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[30 (1428651990861217792)]} 0 2
[junit4:junit4] 2> 20446 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[30 (1428651990861217792)]} 0 6
[junit4:junit4] 2> 20446 T542 C21 P55209 /update {wt=javabin&version=2} {add=[30]} 0 9
[junit4:junit4] 2> 20456 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[31 (1428651990873800704)]} 0 1
[junit4:junit4] 2> 20456 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[31 (1428651990873800704)]} 0 1
[junit4:junit4] 2> 20457 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[31 (1428651990873800704)]} 0 5
[junit4:junit4] 2> 20458 T543 C21 P55209 /update {wt=javabin&version=2} {add=[31]} 0 9
[junit4:junit4] 2> 20468 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[32 (1428651990885335040)]} 0 1
[junit4:junit4] 2> 20468 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[32 (1428651990885335040)]} 0 1
[junit4:junit4] 2> 20469 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[32 (1428651990885335040)]} 0 6
[junit4:junit4] 2> 20470 T540 C21 P55209 /update {wt=javabin&version=2} {add=[32]} 0 10
[junit4:junit4] 2> 20478 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[33 (1428651990897917952)]} 0 1
[junit4:junit4] 2> 20478 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[33 (1428651990897917952)]} 0 1
[junit4:junit4] 2> 20479 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[33 (1428651990897917952)]} 0 5
[junit4:junit4] 2> 20481 T541 C21 P55209 /update {wt=javabin&version=2} {add=[33]} 0 9
[junit4:junit4] 2> 20495 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[34 (1428651990911549440)]} 0 3
[junit4:junit4] 2> 20495 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[34 (1428651990911549440)]} 0 3
[junit4:junit4] 2> 20496 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[34 (1428651990911549440)]} 0 9
[junit4:junit4] 2> 20497 T542 C21 P55209 /update {wt=javabin&version=2} {add=[34]} 0 13
[junit4:junit4] 2> 20511 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[35 (1428651990928326656)]} 0 2
[junit4:junit4] 2> 20511 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[35 (1428651990928326656)]} 0 2
[junit4:junit4] 2> 20512 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[35 (1428651990928326656)]} 0 8
[junit4:junit4] 2> 20513 T543 C21 P55209 /update {wt=javabin&version=2} {add=[35]} 0 12
[junit4:junit4] 2> 20527 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[36 (1428651990946152448)]} 0 2
[junit4:junit4] 2> 20527 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[36 (1428651990946152448)]} 0 2
[junit4:junit4] 2> 20528 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[36 (1428651990946152448)]} 0 8
[junit4:junit4] 2> 20530 T540 C21 P55209 /update {wt=javabin&version=2} {add=[36]} 0 13
[junit4:junit4] 2> 20543 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[37 (1428651990962929664)]} 0 2
[junit4:junit4] 2> 20544 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[37 (1428651990962929664)]} 0 2
[junit4:junit4] 2> 20545 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[37 (1428651990962929664)]} 0 8
[junit4:junit4] 2> 20546 T541 C21 P55209 /update {wt=javabin&version=2} {add=[37]} 0 13
[junit4:junit4] 2> 20555 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[38 (1428651990977609728)]} 0 1
[junit4:junit4] 2> 20555 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[38 (1428651990977609728)]} 0 1
[junit4:junit4] 2> 20556 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[38 (1428651990977609728)]} 0 6
[junit4:junit4] 2> 20557 T540 C21 P55209 /update {wt=javabin&version=2} {add=[38]} 0 9
[junit4:junit4] 2> 20568 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[39 (1428651990989144064)]} 0 2
[junit4:junit4] 2> 20568 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[39 (1428651990989144064)]} 0 2
[junit4:junit4] 2> 20569 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[39 (1428651990989144064)]} 0 8
[junit4:junit4] 2> 20571 T541 C21 P55209 /update {wt=javabin&version=2} {add=[39]} 0 12
[junit4:junit4] 2> 20582 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[40 (1428651991005921280)]} 0 1
[junit4:junit4] 2> 20582 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[40 (1428651991005921280)]} 0 1
[junit4:junit4] 2> 20583 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[40 (1428651991005921280)]} 0 6
[junit4:junit4] 2> 20584 T543 C21 P55209 /update {wt=javabin&version=2} {add=[40]} 0 10
[junit4:junit4] 2> 20596 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[41 (1428651991020601344)]} 0 1
[junit4:junit4] 2> 20596 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[41 (1428651991020601344)]} 0 1
[junit4:junit4] 2> 20597 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[41 (1428651991020601344)]} 0 6
[junit4:junit4] 2> 20598 T542 C21 P55209 /update {wt=javabin&version=2} {add=[41]} 0 10
[junit4:junit4] 2> 20610 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[42 (1428651991033184256)]} 0 1
[junit4:junit4] 2> 20610 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[42 (1428651991033184256)]} 0 1
[junit4:junit4] 2> 20612 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[42 (1428651991033184256)]} 0 8
[junit4:junit4] 2> 20613 T540 C21 P55209 /update {wt=javabin&version=2} {add=[42]} 0 12
[junit4:junit4] 2> 20627 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[43 (1428651991049961472)]} 0 2
[junit4:junit4] 2> 20627 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[43 (1428651991049961472)]} 0 2
[junit4:junit4] 2> 20628 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[43 (1428651991049961472)]} 0 8
[junit4:junit4] 2> 20630 T541 C21 P55209 /update {wt=javabin&version=2} {add=[43]} 0 14
[junit4:junit4] 2> 20643 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[44 (1428651991067787264)]} 0 2
[junit4:junit4] 2> 20643 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[44 (1428651991067787264)]} 0 2
[junit4:junit4] 2> 20644 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[44 (1428651991067787264)]} 0 8
[junit4:junit4] 2> 20645 T543 C21 P55209 /update {wt=javabin&version=2} {add=[44]} 0 12
[junit4:junit4] 2> 20658 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[45 (1428651991083515904)]} 0 2
[junit4:junit4] 2> 20658 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[45 (1428651991083515904)]} 0 2
[junit4:junit4] 2> 20659 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[45 (1428651991083515904)]} 0 7
[junit4:junit4] 2> 20661 T542 C21 P55209 /update {wt=javabin&version=2} {add=[45]} 0 12
[junit4:junit4] 2> 20674 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[46 (1428651991100293120)]} 0 2
[junit4:junit4] 2> 20674 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[46 (1428651991100293120)]} 0 2
[junit4:junit4] 2> 20675 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[46 (1428651991100293120)]} 0 8
[junit4:junit4] 2> 20677 T540 C21 P55209 /update {wt=javabin&version=2} {add=[46]} 0 13
[junit4:junit4] 2> 20691 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[47 (1428651991117070336)]} 0 3
[junit4:junit4] 2> 20691 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[47 (1428651991117070336)]} 0 3
[junit4:junit4] 2> 20692 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[47 (1428651991117070336)]} 0 8
[junit4:junit4] 2> 20693 T541 C21 P55209 /update {wt=javabin&version=2} {add=[47]} 0 13
[junit4:junit4] 2> 20707 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[48 (1428651991134896128)]} 0 2
[junit4:junit4] 2> 20707 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[48 (1428651991134896128)]} 0 2
[junit4:junit4] 2> 20709 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[48 (1428651991134896128)]} 0 9
[junit4:junit4] 2> 20710 T543 C21 P55209 /update {wt=javabin&version=2} {add=[48]} 0 13
[junit4:junit4] 2> 20724 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[49 (1428651991151673344)]} 0 2
[junit4:junit4] 2> 20724 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[49 (1428651991151673344)]} 0 2
[junit4:junit4] 2> 20726 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[49 (1428651991151673344)]} 0 9
[junit4:junit4] 2> 20727 T542 C21 P55209 /update {wt=javabin&version=2} {add=[49]} 0 13
[junit4:junit4] 2> 20740 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[50 (1428651991169499136)]} 0 2
[junit4:junit4] 2> 20740 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[50 (1428651991169499136)]} 0 2
[junit4:junit4] 2> 20742 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[50 (1428651991169499136)]} 0 8
[junit4:junit4] 2> 20743 T543 C21 P55209 /update {wt=javabin&version=2} {add=[50]} 0 13
[junit4:junit4] 2> 20757 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[51 (1428651991186276352)]} 0 2
[junit4:junit4] 2> 20757 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[51 (1428651991186276352)]} 0 1
[junit4:junit4] 2> 20759 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[51 (1428651991186276352)]} 0 9
[junit4:junit4] 2> 20760 T541 C21 P55209 /update {wt=javabin&version=2} {add=[51]} 0 14
[junit4:junit4] 2> 20773 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[52 (1428651991204102144)]} 0 1
[junit4:junit4] 2> 20773 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[52 (1428651991204102144)]} 0 1
[junit4:junit4] 2> 20775 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[52 (1428651991204102144)]} 0 8
[junit4:junit4] 2> 20776 T540 C21 P55209 /update {wt=javabin&version=2} {add=[52]} 0 12
[junit4:junit4] 2> 20790 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[53 (1428651991220879360)]} 0 3
[junit4:junit4] 2> 20790 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[53 (1428651991220879360)]} 0 3
[junit4:junit4] 2> 20791 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[53 (1428651991220879360)]} 0 8
[junit4:junit4] 2> 20793 T542 C21 P55209 /update {wt=javabin&version=2} {add=[53]} 0 13
[junit4:junit4] 2> 20804 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[54 (1428651991238705152)]} 0 1
[junit4:junit4] 2> 20805 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[54 (1428651991238705152)]} 0 2
[junit4:junit4] 2> 20806 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[54 (1428651991238705152)]} 0 7
[junit4:junit4] 2> 20807 T543 C21 P55209 /update {wt=javabin&version=2} {add=[54]} 0 11
[junit4:junit4] 2> 20820 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[55 (1428651991253385216)]} 0 2
[junit4:junit4] 2> 20820 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[55 (1428651991253385216)]} 0 2
[junit4:junit4] 2> 20821 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[55 (1428651991253385216)]} 0 7
[junit4:junit4] 2> 20823 T541 C21 P55209 /update {wt=javabin&version=2} {add=[55]} 0 12
[junit4:junit4] 2> 20836 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[56 (1428651991270162432)]} 0 2
[junit4:junit4] 2> 20836 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[56 (1428651991270162432)]} 0 2
[junit4:junit4] 2> 20837 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[56 (1428651991270162432)]} 0 8
[junit4:junit4] 2> 20838 T540 C21 P55209 /update {wt=javabin&version=2} {add=[56]} 0 12
[junit4:junit4] 2> 20852 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[57 (1428651991286939648)]} 0 2
[junit4:junit4] 2> 20852 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[57 (1428651991286939648)]} 0 2
[junit4:junit4] 2> 20854 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[57 (1428651991286939648)]} 0 9
[junit4:junit4] 2> 20855 T542 C21 P55209 /update {wt=javabin&version=2} {add=[57]} 0 13
[junit4:junit4] 2> 20868 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[58 (1428651991303716864)]} 0 2
[junit4:junit4] 2> 20869 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[58 (1428651991303716864)]} 0 1
[junit4:junit4] 2> 20870 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[58 (1428651991303716864)]} 0 8
[junit4:junit4] 2> 20872 T543 C21 P55209 /update {wt=javabin&version=2} {add=[58]} 0 14
[junit4:junit4] 2> 20886 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[59 (1428651991321542656)]} 0 2
[junit4:junit4] 2> 20886 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[59 (1428651991321542656)]} 0 2
[junit4:junit4] 2> 20887 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[59 (1428651991321542656)]} 0 8
[junit4:junit4] 2> 20888 T541 C21 P55209 /update {wt=javabin&version=2} {add=[59]} 0 13
[junit4:junit4] 2> 20902 T529 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[60 (1428651991339368448)]} 0 2
[junit4:junit4] 2> 20902 T543 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[60 (1428651991339368448)]} 0 2
[junit4:junit4] 2> 20904 T515 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[60 (1428651991339368448)]} 0 9
[junit4:junit4] 2> 20905 T540 C21 P55209 /update {wt=javabin&version=2} {add=[60]} 0 13
[junit4:junit4] 2> 20918 T541 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[61 (1428651991356145664)]} 0 2
[junit4:junit4] 2> 20918 T530 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[61 (1428651991356145664)]} 0 2
[junit4:junit4] 2> 20920 T517 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[61 (1428651991356145664)]} 0 9
[junit4:junit4] 2> 20921 T542 C21 P55209 /update {wt=javabin&version=2} {add=[61]} 0 13
[junit4:junit4] 2> 20935 T527 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[62 (1428651991372922880)]} 0 2
[junit4:junit4] 2> 20935 T540 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[62 (1428651991372922880)]} 0 2
[junit4:junit4] 2> 20936 T514 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[62 (1428651991372922880)]} 0 8
[junit4:junit4] 2> 20937 T543 C21 P55209 /update {wt=javabin&version=2} {add=[62]} 0 13
[junit4:junit4] 2> 20950 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[63 (1428651991390748672)]} 0 1
[junit4:junit4] 2> 20951 T528 C19 P35744 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[63 (1428651991390748672)]} 0 2
[junit4:junit4] 2> 20952 T516 C20 P38060 /update {wt=javabin&distrib.from=http://127.0.0.1:55209/l/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[63 (1428651991390748672)]} 0 8
[junit4:junit4] 2> 20953 T541 C21 P55209 /update {wt=javabin&version=2} {add=[63]} 0 12
[junit4:junit4] 2> 20966 T542 C21 P55209 /update {wt=javabin&distrib.from=http://127.0.0.1:38060/l/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[64 (1428651991406477312)]} 0 2
[junit4:junit4] 2> 20966 T52
[...truncated too long message...]
pl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 32277 T1943 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 32282 T1942 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 32352 T2014 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 32352 T2014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 32353 T2014 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 32353 T2014 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 33105 T1946 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 33445 T2030 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33445 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 33445 T2030 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33445 T2030 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=no_NO_NY, timezone=Canada/Saskatchewan
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=139765704,total=298319872
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSort, FileBasedSpellCheckerTest, ChaosMonkeySafeLeaderTest, QueryParsingTest, TestComponentsName, DisMaxRequestHandlerTest, ClusterStateTest, TestJmxMonitoredMap, CoreContainerCoreInitFailuresTest, TestReversedWildcardFilterFactory, TestSuggestSpellingConverter, PrimitiveFieldTypeTest, TestRangeQuery, TestZkChroot, StandardRequestHandlerTest, IndexBasedSpellCheckerTest, TestDFRSimilarityFactory, UniqFieldsUpdateProcessorFactoryTest, TestStressLucene, EchoParamsTest, TestBinaryField, MultiTermTest, TestPostingsSolrHighlighter, TestLMJelinekMercerSimilarityFactory, SuggesterWFSTTest, PeerSyncTest, TestRecovery, TestSolrXMLSerializer, TestWordDelimiterFilterFactory, CoreAdminHandlerTest, OpenExchangeRatesOrgProviderTest, UpdateParamsTest, DirectSolrSpellCheckerTest, TermsComponentTest, TestAtomicUpdateErrorCases, FileUtilsTest, BasicFunctionalityTest, HighlighterTest, TestFastOutputStream, TestMergePolicyConfig, ShardRoutingTest, PingRequestHandlerTest, TestRTGBase, OverseerTest, TestReload, ReturnFieldsTest, SolrIndexConfigTest, UpdateRequestProcessorFactoryTest, SampleTest, FullSolrCloudDistribCmdsTest, IndexSchemaTest, CopyFieldTest, TermVectorComponentDistributedTest, SpellPossibilityIteratorTest, SimplePostToolTest, SolrCmdDistributorTest, DocValuesMultiTest, TestRandomFaceting, ZkNodePropsTest, TestUtils, MBeansHandlerTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.56s, 1 test, 1 error <<< FAILURES!
[...truncated 402 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 260 suites, 1098 tests, 1 error, 1 failure, 9 ignored (3 assumptions)
Total time: 37 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure