You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/08 02:01:05 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4585 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4585/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:36432/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:36432/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([EDAF7D42149C2DF:8F3C79CC5616A2E3]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([EDAF7D42149C2DF:8F3C79CC5616A2E3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9139 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T954 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 4 T954 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681
[junit4:junit4] 2> 4 T954 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 5 T955 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 6 T955 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 6 T955 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 6 T955 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 6 T955 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 7 T955 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 105 T954 oasc.ZkTestServer.run start zk server on port:37222
[junit4:junit4] 2> 105 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@746f4445
[junit4:junit4] 2> 106 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 111 T960 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 112 T960 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 112 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48369
[junit4:junit4] 2> 112 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48369
[junit4:junit4] 2> 113 T958 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 116 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0000 with negotiated timeout 10000 for client /127.0.0.1:48369
[junit4:junit4] 2> 116 T960 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0000, negotiated timeout = 10000
[junit4:junit4] 2> 116 T961 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@746f4445 name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 117 T954 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 119 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0000
[junit4:junit4] 2> 127 T961 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 127 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0000 closed
[junit4:junit4] 2> 128 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48369 which had sessionid 0x13d47791dec0000
[junit4:junit4] 2> 128 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7aa8a4b8
[junit4:junit4] 2> 129 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 129 T962 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 129 T962 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 129 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48370
[junit4:junit4] 2> 130 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48370
[junit4:junit4] 2> 131 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0001 with negotiated timeout 10000 for client /127.0.0.1:48370
[junit4:junit4] 2> 131 T962 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0001, negotiated timeout = 10000
[junit4:junit4] 2> 131 T963 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aa8a4b8 name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 131 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 132 T954 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 134 T954 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 136 T954 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 137 T954 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 139 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 139 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 142 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 143 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 145 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 146 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 147 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 148 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 150 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 150 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 152 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 152 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 154 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 155 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 156 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 157 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 158 T954 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 159 T954 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 160 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0001
[junit4:junit4] 2> 161 T963 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 161 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0001 closed
[junit4:junit4] 2> 161 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48370 which had sessionid 0x13d47791dec0001
[junit4:junit4] 2> 215 T954 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 227 T954 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59436
[junit4:junit4] 2> 228 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 228 T954 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 229 T954 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838
[junit4:junit4] 2> 229 T954 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/solr.xml
[junit4:junit4] 2> 230 T954 oasc.CoreContainer.<init> New CoreContainer 1305284416
[junit4:junit4] 2> 230 T954 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/'
[junit4:junit4] 2> 231 T954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/'
[junit4:junit4] 2> 256 T954 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 257 T954 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 257 T954 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 258 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 258 T954 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 259 T954 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 259 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 259 T954 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 260 T954 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 260 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 270 T954 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 285 T954 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37222/solr
[junit4:junit4] 2> 285 T954 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 286 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6964777e
[junit4:junit4] 2> 287 T973 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 287 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 288 T973 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 288 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48371
[junit4:junit4] 2> 288 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48371
[junit4:junit4] 2> 289 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0002 with negotiated timeout 20000 for client /127.0.0.1:48371
[junit4:junit4] 2> 289 T973 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0002, negotiated timeout = 20000
[junit4:junit4] 2> 290 T974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6964777e name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 290 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 291 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0002
[junit4:junit4] 2> 291 T974 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 292 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48371 which had sessionid 0x13d47791dec0002
[junit4:junit4] 2> 291 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0002 closed
[junit4:junit4] 2> 292 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 297 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@59b2cdf2
[junit4:junit4] 2> 298 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 298 T975 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 299 T975 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 299 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48372
[junit4:junit4] 2> 299 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48372
[junit4:junit4] 2> 300 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0003 with negotiated timeout 20000 for client /127.0.0.1:48372
[junit4:junit4] 2> 300 T975 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0003, negotiated timeout = 20000
[junit4:junit4] 2> 301 T976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59b2cdf2 name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 301 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 302 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 303 T954 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 305 T954 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59436_
[junit4:junit4] 2> 305 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59436_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59436_
[junit4:junit4] 2> 306 T954 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59436_
[junit4:junit4] 2> 308 T954 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 311 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 311 T954 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 314 T954 oasc.Overseer.start Overseer (id=89306153135898627-127.0.0.1:59436_-n_0000000000) starting
[junit4:junit4] 2> 315 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 317 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 318 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 319 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 320 T978 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 320 T954 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 322 T954 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 323 T954 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 325 T977 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 329 T979 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/collection1
[junit4:junit4] 2> 329 T979 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 330 T979 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 330 T979 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 331 T979 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/collection1/'
[junit4:junit4] 2> 331 T979 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/collection1/lib/README' to classloader
[junit4:junit4] 2> 331 T979 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 362 T979 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 389 T979 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 390 T979 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 394 T979 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 766 T979 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 773 T979 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 775 T979 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 787 T979 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 790 T979 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 792 T979 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 793 T979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 793 T979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 793 T979 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 794 T979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 794 T979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 794 T979 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362703752838/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/
[junit4:junit4] 2> 795 T979 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41e89fd1
[junit4:junit4] 2> 795 T979 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 801 T979 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data forceNew: false
[junit4:junit4] 2> 802 T979 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/index/
[junit4:junit4] 2> 802 T979 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 802 T979 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/index forceNew: false
[junit4:junit4] 2> 836 T979 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d2c6564; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 836 T979 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 838 T979 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 838 T979 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 838 T979 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 839 T979 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 839 T979 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 839 T979 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 839 T979 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 840 T979 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 840 T979 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 842 T979 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 846 T979 oass.SolrIndexSearcher.<init> Opening Searcher@7c02cdc6 main
[junit4:junit4] 2> 846 T979 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 846 T979 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 849 T980 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c02cdc6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 850 T979 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 850 T979 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 851 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1829 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1830 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59436",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:59436_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 1831 T977 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1831 T977 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1832 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1840 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1853 T979 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1853 T979 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59436 collection:control_collection shard:shard1
[junit4:junit4] 2> 1854 T979 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1862 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 1863 T979 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1863 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1866 T979 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1866 T979 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1867 T979 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59436/collection1/
[junit4:junit4] 2> 1867 T979 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1867 T979 oasc.SyncStrategy.syncToMe http://127.0.0.1:59436/collection1/ has no replicas
[junit4:junit4] 2> 1868 T979 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59436/collection1/
[junit4:junit4] 2> 1868 T979 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1873 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3346 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3356 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3380 T979 oasc.ZkController.register We are http://127.0.0.1:59436/collection1/ and leader is http://127.0.0.1:59436/collection1/
[junit4:junit4] 2> 3380 T979 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59436
[junit4:junit4] 2> 3380 T979 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3381 T979 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3381 T979 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3382 T979 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3383 T954 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3384 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3384 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3387 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3388 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7635e8bf
[junit4:junit4] 2> 3388 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3389 T981 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3389 T981 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 3389 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48380
[junit4:junit4] 2> 3389 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48380
[junit4:junit4] 2> 3390 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0004 with negotiated timeout 10000 for client /127.0.0.1:48380
[junit4:junit4] 2> 3390 T981 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0004, negotiated timeout = 10000
[junit4:junit4] 2> 3390 T982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7635e8bf name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3391 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3392 T954 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3401 T954 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3454 T954 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3456 T954 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45170
[junit4:junit4] 2> 3457 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3458 T954 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3458 T954 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079
[junit4:junit4] 2> 3458 T954 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/solr.xml
[junit4:junit4] 2> 3459 T954 oasc.CoreContainer.<init> New CoreContainer 844152138
[junit4:junit4] 2> 3459 T954 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/'
[junit4:junit4] 2> 3459 T954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/'
[junit4:junit4] 2> 3474 T954 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3474 T954 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3474 T954 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3475 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3475 T954 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3475 T954 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3475 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3476 T954 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3476 T954 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3476 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3482 T954 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3490 T954 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37222/solr
[junit4:junit4] 2> 3490 T954 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3490 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ea76d58
[junit4:junit4] 2> 3491 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3491 T992 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3492 T992 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 3493 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48381
[junit4:junit4] 2> 3493 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48381
[junit4:junit4] 2> 3494 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0005 with negotiated timeout 20000 for client /127.0.0.1:48381
[junit4:junit4] 2> 3494 T992 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0005, negotiated timeout = 20000
[junit4:junit4] 2> 3495 T993 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea76d58 name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3495 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3497 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0005
[junit4:junit4] 2> 3497 T993 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3497 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48381 which had sessionid 0x13d47791dec0005
[junit4:junit4] 2> 3497 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0005 closed
[junit4:junit4] 2> 3498 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3500 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@429a6ce6
[junit4:junit4] 2> 3501 T994 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3501 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3502 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48382
[junit4:junit4] 2> 3502 T994 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 3503 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48382
[junit4:junit4] 2> 3504 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0006 with negotiated timeout 20000 for client /127.0.0.1:48382
[junit4:junit4] 2> 3504 T994 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0006, negotiated timeout = 20000
[junit4:junit4] 2> 3504 T995 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@429a6ce6 name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3504 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3505 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3506 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3508 T954 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4511 T954 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45170_
[junit4:junit4] 2> 4513 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45170_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45170_
[junit4:junit4] 2> 4514 T954 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45170_
[junit4:junit4] 2> 4517 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4518 T982 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4518 T995 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4520 T976 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4527 T996 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/collection1
[junit4:junit4] 2> 4528 T996 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4529 T996 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4529 T996 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4531 T996 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/collection1/'
[junit4:junit4] 2> 4532 T996 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/collection1/lib/README' to classloader
[junit4:junit4] 2> 4532 T996 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4574 T996 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 4616 T996 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4617 T996 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4620 T996 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4870 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4871 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59436",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:59436_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 4875 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4875 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4875 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4975 T996 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 4980 T996 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 4981 T996 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 4997 T996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5000 T996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5003 T996 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5003 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5004 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5004 T996 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5005 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5005 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5005 T996 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/
[junit4:junit4] 2> 5005 T996 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41e89fd1
[junit4:junit4] 2> 5006 T996 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 5006 T996 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1 forceNew: false
[junit4:junit4] 2> 5006 T996 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index/
[junit4:junit4] 2> 5007 T996 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5007 T996 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index forceNew: false
[junit4:junit4] 2> 5010 T996 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a627fd0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5010 T996 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5012 T996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5013 T996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5014 T996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5015 T996 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5015 T996 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5016 T996 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5016 T996 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5017 T996 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5017 T996 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5022 T996 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5027 T996 oass.SolrIndexSearcher.<init> Opening Searcher@4f0ca640 main
[junit4:junit4] 2> 5027 T996 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5028 T996 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5032 T997 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f0ca640 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5033 T996 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5033 T996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6381 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6382 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45170",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:45170_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 6383 T977 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6383 T977 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 6389 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6389 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6389 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7035 T996 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7035 T996 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45170 collection:collection1 shard:shard2
[junit4:junit4] 2> 7037 T996 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 7046 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7047 T996 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7048 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7051 T996 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7051 T996 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7052 T996 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45170/collection1/
[junit4:junit4] 2> 7052 T996 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7052 T996 oasc.SyncStrategy.syncToMe http://127.0.0.1:45170/collection1/ has no replicas
[junit4:junit4] 2> 7053 T996 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45170/collection1/
[junit4:junit4] 2> 7053 T996 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 7061 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7895 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7909 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7909 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7909 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7916 T996 oasc.ZkController.register We are http://127.0.0.1:45170/collection1/ and leader is http://127.0.0.1:45170/collection1/
[junit4:junit4] 2> 7917 T996 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45170
[junit4:junit4] 2> 7917 T996 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7917 T996 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 7918 T996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7920 T996 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7922 T954 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 7922 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7923 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7981 T954 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7984 T954 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36432
[junit4:junit4] 2> 7986 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7987 T954 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7987 T954 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607
[junit4:junit4] 2> 7988 T954 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/solr.xml
[junit4:junit4] 2> 7989 T954 oasc.CoreContainer.<init> New CoreContainer 173855828
[junit4:junit4] 2> 7989 T954 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/'
[junit4:junit4] 2> 7990 T954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/'
[junit4:junit4] 2> 8008 T954 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8009 T954 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8009 T954 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8009 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8009 T954 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8010 T954 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8010 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8010 T954 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8011 T954 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8011 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8016 T954 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8024 T954 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37222/solr
[junit4:junit4] 2> 8024 T954 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8025 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e928d5e
[junit4:junit4] 2> 8025 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8026 T1007 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8027 T1007 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 8027 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48387
[junit4:junit4] 2> 8027 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48387
[junit4:junit4] 2> 8029 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0007 with negotiated timeout 20000 for client /127.0.0.1:48387
[junit4:junit4] 2> 8029 T1007 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0007, negotiated timeout = 20000
[junit4:junit4] 2> 8029 T1008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e928d5e name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8030 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8031 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0007
[junit4:junit4] 2> 8032 T1008 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8032 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0007 closed
[junit4:junit4] 2> 8032 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48387 which had sessionid 0x13d47791dec0007
[junit4:junit4] 2> 8032 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8049 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7bc56dcf
[junit4:junit4] 2> 8050 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8050 T1009 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8051 T1009 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 8051 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48388
[junit4:junit4] 2> 8052 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48388
[junit4:junit4] 2> 8053 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0008 with negotiated timeout 20000 for client /127.0.0.1:48388
[junit4:junit4] 2> 8053 T1009 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0008, negotiated timeout = 20000
[junit4:junit4] 2> 8054 T1010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bc56dcf name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8054 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8055 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8057 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8059 T954 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9063 T954 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36432_
[junit4:junit4] 2> 9065 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36432_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36432_
[junit4:junit4] 2> 9066 T954 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36432_
[junit4:junit4] 2> 9070 T995 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9070 T1010 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9070 T982 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9070 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9070 T976 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9071 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9071 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9079 T1011 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/collection1
[junit4:junit4] 2> 9079 T1011 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9080 T1011 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9080 T1011 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9082 T1011 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/collection1/'
[junit4:junit4] 2> 9083 T1011 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/collection1/lib/README' to classloader
[junit4:junit4] 2> 9084 T1011 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9110 T1011 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 9135 T1011 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9136 T1011 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9139 T1011 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9416 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9417 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45170",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:45170_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 9434 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9434 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9434 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9434 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9495 T1011 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9500 T1011 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9502 T1011 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9520 T1011 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9535 T1011 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9540 T1011 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9542 T1011 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9543 T1011 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9543 T1011 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9545 T1011 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9545 T1011 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9545 T1011 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362703760607/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/
[junit4:junit4] 2> 9546 T1011 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41e89fd1
[junit4:junit4] 2> 9546 T1011 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 9547 T1011 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2 forceNew: false
[junit4:junit4] 2> 9548 T1011 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index/
[junit4:junit4] 2> 9548 T1011 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9549 T1011 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index forceNew: false
[junit4:junit4] 2> 9554 T1011 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ef42c7d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9554 T1011 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9556 T1011 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9556 T1011 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9556 T1011 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9557 T1011 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9557 T1011 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9557 T1011 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9557 T1011 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9558 T1011 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9558 T1011 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9562 T1011 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9567 T1011 oass.SolrIndexSearcher.<init> Opening Searcher@21db66e5 main
[junit4:junit4] 2> 9568 T1011 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9568 T1011 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9575 T1012 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21db66e5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9577 T1011 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9578 T1011 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10940 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10942 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36432",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:36432_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 10942 T977 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10942 T977 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 10949 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10949 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10949 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10949 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11580 T1011 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11580 T1011 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36432 collection:collection1 shard:shard1
[junit4:junit4] 2> 11581 T1011 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 11591 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 11592 T1011 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11592 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11595 T1011 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11596 T1011 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11596 T1011 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36432/collection1/
[junit4:junit4] 2> 11596 T1011 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11597 T1011 oasc.SyncStrategy.syncToMe http://127.0.0.1:36432/collection1/ has no replicas
[junit4:junit4] 2> 11597 T1011 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36432/collection1/
[junit4:junit4] 2> 11597 T1011 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 11603 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12455 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12467 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12467 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12467 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12467 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12509 T1011 oasc.ZkController.register We are http://127.0.0.1:36432/collection1/ and leader is http://127.0.0.1:36432/collection1/
[junit4:junit4] 2> 12509 T1011 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36432
[junit4:junit4] 2> 12509 T1011 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12510 T1011 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12510 T1011 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12513 T1011 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12515 T954 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12515 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12516 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12580 T954 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12583 T954 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42147
[junit4:junit4] 2> 12586 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12587 T954 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12587 T954 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200
[junit4:junit4] 2> 12588 T954 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/solr.xml
[junit4:junit4] 2> 12588 T954 oasc.CoreContainer.<init> New CoreContainer 921100605
[junit4:junit4] 2> 12589 T954 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/'
[junit4:junit4] 2> 12590 T954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/'
[junit4:junit4] 2> 12606 T954 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12607 T954 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12607 T954 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12607 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12607 T954 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12608 T954 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12608 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12608 T954 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12608 T954 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12609 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12614 T954 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12621 T954 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37222/solr
[junit4:junit4] 2> 12622 T954 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12622 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6137e226
[junit4:junit4] 2> 12623 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12623 T1022 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12624 T1022 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 12624 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48392
[junit4:junit4] 2> 12625 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48392
[junit4:junit4] 2> 12626 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec0009 with negotiated timeout 20000 for client /127.0.0.1:48392
[junit4:junit4] 2> 12626 T1022 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec0009, negotiated timeout = 20000
[junit4:junit4] 2> 12626 T1023 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6137e226 name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12626 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12628 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0009
[junit4:junit4] 2> 12628 T1023 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12628 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0009 closed
[junit4:junit4] 2> 12628 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48392 which had sessionid 0x13d47791dec0009
[junit4:junit4] 2> 12629 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12631 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@28ca392
[junit4:junit4] 2> 12632 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12632 T1024 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12633 T1024 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 12633 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48393
[junit4:junit4] 2> 12633 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48393
[junit4:junit4] 2> 12634 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec000a with negotiated timeout 20000 for client /127.0.0.1:48393
[junit4:junit4] 2> 12634 T1024 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec000a, negotiated timeout = 20000
[junit4:junit4] 2> 12634 T1025 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28ca392 name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12635 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12636 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12637 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12638 T954 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13642 T954 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42147_
[junit4:junit4] 2> 13643 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42147_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42147_
[junit4:junit4] 2> 13644 T954 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42147_
[junit4:junit4] 2> 13648 T995 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13649 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13649 T1010 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13649 T976 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13649 T982 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13650 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13649 T1025 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13649 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13649 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13658 T1026 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/collection1
[junit4:junit4] 2> 13659 T1026 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13660 T1026 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13660 T1026 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13662 T1026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/collection1/'
[junit4:junit4] 2> 13663 T1026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/collection1/lib/README' to classloader
[junit4:junit4] 2> 13663 T1026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13690 T1026 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 13741 T1026 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13743 T1026 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13746 T1026 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13978 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13993 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36432",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:36432_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 13998 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13998 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13998 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13998 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13998 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14110 T1026 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14115 T1026 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14117 T1026 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14135 T1026 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14138 T1026 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14140 T1026 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14142 T1026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14142 T1026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14142 T1026 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14143 T1026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14143 T1026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14144 T1026 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362703765200/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/
[junit4:junit4] 2> 14144 T1026 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41e89fd1
[junit4:junit4] 2> 14144 T1026 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14145 T1026 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3 forceNew: false
[junit4:junit4] 2> 14145 T1026 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index/
[junit4:junit4] 2> 14145 T1026 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14145 T1026 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index forceNew: false
[junit4:junit4] 2> 14151 T1026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f8fec98; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14151 T1026 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14152 T1026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14152 T1026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14153 T1026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14153 T1026 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14154 T1026 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14154 T1026 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14154 T1026 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14154 T1026 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14155 T1026 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14157 T1026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14159 T1026 oass.SolrIndexSearcher.<init> Opening Searcher@5b3772af main
[junit4:junit4] 2> 14160 T1026 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14160 T1026 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14163 T1027 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b3772af main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14165 T1026 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14165 T1026 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15504 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15506 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42147",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:42147_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 15506 T977 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15506 T977 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 15512 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15512 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15513 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15512 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15512 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16166 T1026 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16167 T1026 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42147 collection:collection1 shard:shard2
[junit4:junit4] 2> 16172 T1026 oasc.ZkController.register We are http://127.0.0.1:42147/collection1/ and leader is http://127.0.0.1:45170/collection1/
[junit4:junit4] 2> 16172 T1026 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42147
[junit4:junit4] 2> 16172 T1026 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16173 T1026 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C29 name=collection1 org.apache.solr.core.SolrCore@4685db1c url=http://127.0.0.1:42147/collection1 node=127.0.0.1:42147_ C29_STATE=coll:collection1 core:collection1 props:{collection=collection1, core=collection1, base_url=http://127.0.0.1:42147, state=down, node_name=127.0.0.1:42147_}
[junit4:junit4] 2> 16174 T1028 C29 P42147 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16175 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16175 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16176 T1028 C29 P42147 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16176 T1028 C29 P42147 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16177 T954 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16178 T1028 C29 P42147 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16177 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16178 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16247 T954 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16250 T954 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35152
[junit4:junit4] 2> 16251 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16251 T954 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16251 T954 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861
[junit4:junit4] 2> 16252 T954 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/solr.xml
[junit4:junit4] 2> 16252 T954 oasc.CoreContainer.<init> New CoreContainer 2065789454
[junit4:junit4] 2> 16252 T954 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/'
[junit4:junit4] 2> 16253 T954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/'
[junit4:junit4] 2> 16267 T954 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16267 T954 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16267 T954 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16267 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16268 T954 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16268 T954 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16268 T954 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16269 T954 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16269 T954 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16269 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16289 T954 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16301 T954 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37222/solr
[junit4:junit4] 2> 16302 T954 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16302 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2a79c4b7
[junit4:junit4] 2> 16304 T1038 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16304 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16305 T1038 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 16306 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48398
[junit4:junit4] 2> 16306 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48398
[junit4:junit4] 2> 16308 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec000b with negotiated timeout 20000 for client /127.0.0.1:48398
[junit4:junit4] 2> 16308 T1038 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec000b, negotiated timeout = 20000
[junit4:junit4] 2> 16309 T1039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a79c4b7 name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16309 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16311 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec000b
[junit4:junit4] 2> 16312 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48398 which had sessionid 0x13d47791dec000b
[junit4:junit4] 2> 16312 T1039 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16312 T954 oaz.ZooKeeper.close Session: 0x13d47791dec000b closed
[junit4:junit4] 2> 16313 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16319 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6ba1abef
[junit4:junit4] 2> 16321 T1040 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16321 T1040 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 16321 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48399
[junit4:junit4] 2> 16321 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16322 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48399
[junit4:junit4] 2> 16324 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec000c with negotiated timeout 20000 for client /127.0.0.1:48399
[junit4:junit4] 2> 16324 T1040 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec000c, negotiated timeout = 20000
[junit4:junit4] 2> 16324 T1041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ba1abef name:ZooKeeperConnection Watcher:127.0.0.1:37222/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16324 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16325 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16327 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16330 T954 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17019 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17021 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42147",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "node_name":"127.0.0.1:42147_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 17027 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17027 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17027 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17028 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17028 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17028 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17186 T989 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&wt=javabin&coreNodeName=4&core=collection1&version=2&state=recovering&nodeName=127.0.0.1:42147_} status=0 QTime=1000
[junit4:junit4] 2> 17334 T954 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35152_
[junit4:junit4] 2> 17336 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35152_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35152_
[junit4:junit4] 2> 17337 T954 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35152_
[junit4:junit4] 2> 17340 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17340 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17340 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17341 T982 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17341 T1025 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17341 T1010 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17341 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17341 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17342 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17343 T995 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17343 T976 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17344 T1041 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17351 T1042 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/collection1
[junit4:junit4] 2> 17352 T1042 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17353 T1042 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17353 T1042 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17355 T1042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/collection1/'
[junit4:junit4] 2> 17356 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/collection1/lib/README' to classloader
[junit4:junit4] 2> 17356 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17387 T1042 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 17426 T1042 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17427 T1042 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17432 T1042 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17803 T1042 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17814 T1042 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17816 T1042 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17833 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17836 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17839 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17841 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17841 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17842 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17843 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17843 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17843 T1042 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362703768861/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/
[junit4:junit4] 2> 17844 T1042 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41e89fd1
[junit4:junit4] 2> 17844 T1042 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17845 T1042 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4 forceNew: false
[junit4:junit4] 2> 17845 T1042 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index/
[junit4:junit4] 2> 17846 T1042 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17846 T1042 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index forceNew: false
[junit4:junit4] 2> 17851 T1042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2f142dcb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17851 T1042 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17854 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17855 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17855 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17856 T1042 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17857 T1042 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17857 T1042 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17858 T1042 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17858 T1042 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17859 T1042 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17864 T1042 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17869 T1042 oass.SolrIndexSearcher.<init> Opening Searcher@37332dd main
[junit4:junit4] 2> 17870 T1042 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17870 T1042 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17876 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37332dd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17879 T1042 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17879 T1042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18535 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18537 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35152",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:35152_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 18537 T977 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18537 T977 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 18543 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18543 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18543 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18543 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18543 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18543 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18881 T1042 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18881 T1042 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35152 collection:collection1 shard:shard1
[junit4:junit4] 2> 18886 T1042 oasc.ZkController.register We are http://127.0.0.1:35152/collection1/ and leader is http://127.0.0.1:36432/collection1/
[junit4:junit4] 2> 18887 T1042 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35152
[junit4:junit4] 2> 18887 T1042 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18887 T1042 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C30 name=collection1 org.apache.solr.core.SolrCore@7eaffe90 url=http://127.0.0.1:35152/collection1 node=127.0.0.1:35152_ C30_STATE=coll:collection1 core:collection1 props:{collection=collection1, core=collection1, base_url=http://127.0.0.1:35152, state=down, node_name=127.0.0.1:35152_}
[junit4:junit4] 2> 18889 T1044 C30 P35152 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18889 T1042 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18890 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18890 T1044 C30 P35152 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18890 T1044 C30 P35152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18891 T954 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18892 T954 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18892 T1044 C30 P35152 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18892 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18900 T954 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18902 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18910 T990 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/onenodecollectioncore
[junit4:junit4] 2> 18911 T990 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 18912 T990 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 18913 T990 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 18915 T990 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 18915 T990 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 18919 T990 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 18921 T990 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/onenodecollectioncore/'
[junit4:junit4] 2> 18963 T990 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 19009 T990 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 19011 T990 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 19016 T990 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> C29_STATE=coll:collection1 core:collection1 props:{shard=shard2, collection=collection1, core=collection1, base_url=http://127.0.0.1:42147, state=recovering, node_name=127.0.0.1:42147_}
[junit4:junit4] 2> 19188 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45170/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19189 T1028 C29 P42147 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42147 START replicas=[http://127.0.0.1:45170/collection1/] nUpdates=100
[junit4:junit4] 2> 19189 T1028 C29 P42147 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19200 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19200 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19200 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19201 T1028 C29 P42147 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19201 T1028 C29 P42147 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45170/collection1/. core=collection1
[junit4:junit4] 2> 19201 T1028 C29 P42147 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C31 name=collection1 org.apache.solr.core.SolrCore@4ab1579f url=http://127.0.0.1:45170/collection1 node=127.0.0.1:45170_ C31_STATE=coll:collection1 core:collection1 props:{shard=shard2, collection=collection1, core=collection1, base_url=http://127.0.0.1:45170, state=active, node_name=127.0.0.1:45170_, leader=true}
[junit4:junit4] 2> 19206 T991 C31 P45170 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1
[junit4:junit4] 2> 19208 T989 C31 P45170 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19211 T989 C31 P45170 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a627fd0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19211 T989 C31 P45170 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19224 T989 C31 P45170 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a627fd0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a627fd0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19224 T989 C31 P45170 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19225 T989 C31 P45170 oass.SolrIndexSearcher.<init> Opening Searcher@9f7504b realtime
[junit4:junit4] 2> 19225 T989 C31 P45170 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19225 T989 C31 P45170 /update {commit=true&openSearcher=false&commit_end_point=true&waitSearcher=true&wt=javabin&softCommit=false&version=2} {commit=} 0 17
[junit4:junit4] 2> 19226 T1028 C29 P42147 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19226 T1028 C29 P42147 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19236 T988 C31 P45170 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19236 T988 C31 P45170 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=8
[junit4:junit4] 2> 19237 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19237 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19237 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19240 T989 C31 P45170 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 19240 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19241 T1028 C29 P42147 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index.20130308124931918 forceNew: false
[junit4:junit4] 2> 19242 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index.20130308124931918 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c9bda73; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 19244 T991 C31 P45170 REQ /replication {command=filecontent&file=segments_2&qt=/replication&wt=filestream&checksum=true&generation=2} status=0 QTime=0
[junit4:junit4] 2> 19245 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19254 T1028 C29 P42147 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19255 T1028 C29 P42147 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19271 T1028 C29 P42147 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f8fec98; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f8fec98; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19272 T1028 C29 P42147 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19273 T1028 C29 P42147 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19273 T1028 C29 P42147 oass.SolrIndexSearcher.<init> Opening Searcher@52388ef5 main
[junit4:junit4] 2> 19274 T1027 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@52388ef5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19274 T1028 C29 P42147 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty3/index.20130308124931918 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c9bda73; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4] 2> 19275 T1028 C29 P42147 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19275 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19275 T1028 C29 P42147 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19275 T1028 C29 P42147 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19294 T1028 C29 P42147 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19388 T990 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19393 T990 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19395 T990 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19414 T990 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19419 T990 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19424 T990 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19425 T990 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19426 T990 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19426 T990 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19428 T990 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19429 T990 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19429 T990 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362703756079/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection/
[junit4:junit4] 2> 19430 T990 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@41e89fd1
[junit4:junit4] 2> 19431 T990 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 19431 T990 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection forceNew: false
[junit4:junit4] 2> 19432 T990 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection/index/
[junit4:junit4] 2> 19433 T990 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19433 T990 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection/index forceNew: false
[junit4:junit4] 2> 19439 T990 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@45925b68; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19440 T990 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19443 T990 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19444 T990 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19445 T990 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19445 T990 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19446 T990 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19447 T990 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19447 T990 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19448 T990 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19449 T990 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19453 T990 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19458 T990 oass.SolrIndexSearcher.<init> Opening Searcher@3b05c305 main
[junit4:junit4] 2> 19459 T990 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19460 T990 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19464 T1047 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@3b05c305 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19466 T990 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 20050 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20052 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35152",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "node_name":"127.0.0.1:35152_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 20057 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42147",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:42147_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 20063 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45170",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:45170_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 20063 T977 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 20063 T977 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20070 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20070 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20070 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20070 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20070 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20070 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20469 T990 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20469 T990 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:45170 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20471 T990 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20483 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20484 T990 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20485 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20488 T990 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20488 T990 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20489 T990 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45170/onenodecollectioncore/
[junit4:junit4] 2> 20489 T990 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20490 T990 oasc.SyncStrategy.syncToMe http://127.0.0.1:45170/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20491 T990 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45170/onenodecollectioncore/
[junit4:junit4] 2> 20491 T990 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20498 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20901 T1003 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&wt=javabin&coreNodeName=5&core=collection1&version=2&state=recovering&nodeName=127.0.0.1:35152_} status=0 QTime=2000
[junit4:junit4] 2> 21582 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21594 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21594 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21594 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21594 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21594 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21594 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21605 T990 oasc.ZkController.register We are http://127.0.0.1:45170/onenodecollectioncore/ and leader is http://127.0.0.1:45170/onenodecollectioncore/
[junit4:junit4] 2> 21606 T990 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:45170
[junit4:junit4] 2> 21606 T990 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21607 T990 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21609 T990 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21611 T990 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=CREATE&numShards=1&wt=javabin&name=onenodecollectioncore&collection=onenodecollection&version=2&roles=none&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362703752681/onenodecollection} status=0 QTime=2701
[junit4:junit4] 2> 21612 T954 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21613 T954 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22616 T954 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C30_STATE=coll:collection1 core:collection1 props:{shard=shard1, collection=collection1, core=collection1, base_url=http://127.0.0.1:35152, state=recovering, node_name=127.0.0.1:35152_}
[junit4:junit4] 2> 22903 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36432/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22904 T1044 C30 P35152 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35152 START replicas=[http://127.0.0.1:36432/collection1/] nUpdates=100
[junit4:junit4] 2> 22904 T1044 C30 P35152 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22905 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22905 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22905 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22905 T1044 C30 P35152 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22905 T1044 C30 P35152 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:36432/collection1/. core=collection1
[junit4:junit4] 2> 22906 T1044 C30 P35152 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C32 name=collection1 org.apache.solr.core.SolrCore@63e742cb url=http://127.0.0.1:36432/collection1 node=127.0.0.1:36432_ C32_STATE=coll:collection1 core:collection1 props:{shard=shard1, collection=collection1, core=collection1, base_url=http://127.0.0.1:36432, state=active, node_name=127.0.0.1:36432_, leader=true}
[junit4:junit4] 2> 22912 T1003 C32 P36432 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1
[junit4:junit4] 2> 22915 T1004 C32 P36432 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22919 T1004 C32 P36432 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ef42c7d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22920 T1004 C32 P36432 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22934 T1004 C32 P36432 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ef42c7d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ef42c7d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22935 T1004 C32 P36432 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22936 T1004 C32 P36432 oass.SolrIndexSearcher.<init> Opening Searcher@6e945680 realtime
[junit4:junit4] 2> 22936 T1004 C32 P36432 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22937 T1004 C32 P36432 /update {commit=true&openSearcher=false&commit_end_point=true&waitSearcher=true&wt=javabin&softCommit=false&version=2} {commit=} 0 22
[junit4:junit4] 2> 22938 T1044 C30 P35152 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22938 T1044 C30 P35152 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22940 T1003 C32 P36432 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22940 T1003 C32 P36432 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 22941 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22941 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22941 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22943 T1004 C32 P36432 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 22944 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22945 T1044 C30 P35152 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index.20130308124935621 forceNew: false
[junit4:junit4] 2> 22945 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index.20130308124935621 lockFactory=org.apache.lucene.store.NativeFSLockFactory@58b69556; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 22947 T1005 C32 P36432 REQ /replication {command=filecontent&file=segments_2&qt=/replication&wt=filestream&checksum=true&generation=2} status=0 QTime=0
[junit4:junit4] 2> 22949 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22954 T1044 C30 P35152 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22954 T1044 C30 P35152 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22956 T1044 C30 P35152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2f142dcb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2f142dcb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22957 T1044 C30 P35152 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22957 T1044 C30 P35152 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22957 T1044 C30 P35152 oass.SolrIndexSearcher.<init> Opening Searcher@4f201136 main
[junit4:junit4] 2> 22958 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f201136 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22958 T1044 C30 P35152 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/jetty4/index.20130308124935621 lockFactory=org.apache.lucene.store.NativeFSLockFactory@58b69556; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4] 2> 22959 T1044 C30 P35152 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22959 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22959 T1044 C30 P35152 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22959 T1044 C30 P35152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22961 T1044 C30 P35152 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23103 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23104 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45170",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:45170_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 23109 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35152",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:35152_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 23134 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23134 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23134 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23134 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23134 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23134 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23619 T954 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23621 T954 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23621 T954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23640 T1005 oejs.Response.sendError WARNING Committed before 404 Can not find: /onenodecollectioncore/update
[junit4:junit4] 2> 23640 T954 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37222 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@40bce7b7
[junit4:junit4] 2> 23641 T1005 oejs.ServletHandler.doHandle WARNING /onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 23642 T1050 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:37222. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 23641 T954 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 23643 T1050 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:37222, initiating session
[junit4:junit4] 2> 23643 T956 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48421
[junit4:junit4] 2> 23644 T956 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48421
[junit4:junit4] 2> 23645 T958 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47791dec000d with negotiated timeout 10000 for client /127.0.0.1:48421
[junit4:junit4] 2> 23645 T1050 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:37222, sessionid = 0x13d47791dec000d, negotiated timeout = 10000
[junit4:junit4] 2> 23646 T1051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40bce7b7 name:ZooKeeperConnection Watcher:127.0.0.1:37222 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 23646 T954 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 23722 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec000d
[junit4:junit4] 2> 23723 T1051 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23723 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48421 which had sessionid 0x13d47791dec000d
[junit4:junit4] 2> 23723 T954 oaz.ZooKeeper.close Session: 0x13d47791dec000d closed
[junit4:junit4] 2> 23724 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0004
[junit4:junit4] 2> 23725 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48380 which had sessionid 0x13d47791dec0004
[junit4:junit4] 2> 23725 T982 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23725 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0004 closed
[junit4:junit4] 2> 23730 T954 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 59436
[junit4:junit4] 2> 23730 T954 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1305284416
[junit4:junit4] 2> 24645 T977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24646 T977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59436",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:59436_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 24654 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24654 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24654 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24654 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24654 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25733 T954 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1eaf7f7d
[junit4:junit4] 2> 25737 T954 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25737 T954 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 25737 T954 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 25738 T954 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 25738 T954 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 25739 T954 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/index
[junit4:junit4] 2> 25739 T954 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data/index
[junit4:junit4] 2> 25739 T954 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data
[junit4:junit4] 2> 25740 T954 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362703752681/control/data
[junit4:junit4] 2> 25740 T977 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89306153135898627-127.0.0.1:59436_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 25741 T959 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47791dec0003
[junit4:junit4] 2> 25742 T1025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25742 T956 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48372 which had sessionid 0x13d47791dec0003
[junit4:junit4] 2> 25742 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:delete cxid:0xc0 zxid:0xe4 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 25743 T1041 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25742 T954 oaz.ZooKeeper.close Session: 0x13d47791dec0003 closed
[junit4:junit4] 2> 25743 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25743 T1010 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25743 T995 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 25743 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25744 T1025 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25745 T995 oasc.Overseer.start Overseer (id=89306153135898630-127.0.0.1:45170_-n_0000000001) starting
[junit4:junit4] 2> 25746 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0xc5 zxid:0xe6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25746 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0xc6 zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25747 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0xc7 zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25747 T959 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47791dec0006 type:create cxid:0xc8 zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25748 T995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25748 T1053 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 25749 T995 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25750 T1052 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 25765 T954 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 25817 T954 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 45170
[junit4:junit4] 2> 25818 T954 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=844152138
[junit4:junit4] 2> 27042 T976 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27042 T976 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27043 T976 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27043 T976 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 27255 T1052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27256 T1052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45170__onenodecollectioncore",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45170",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:45170_",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 27261 T1052 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2>
[...truncated too long message...]
1> /solr/aliases.json (0)
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=EDAF7D42149C2DF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_CU -Dtests.timezone=Europe/Copenhagen -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 136s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([EDAF7D42149C2DF:8F3C79CC5616A2E3]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 136458 T2204 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 136469 T2203 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 137150 T2207 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 137539 T2282 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 137539 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 137539 T2282 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 137539 T2282 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=66), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=66)), sim=DefaultSimilarity, locale=es_CU, timezone=Europe/Copenhagen
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=108359816,total=206966784
[junit4:junit4] 2> NOTE: All tests run in this JVM: [CollectionsAPIDistributedZkTest, QueryParsingTest, TestDefaultSimilarityFactory, PeerSyncTest, ReturnFieldsTest, TestSuggestSpellingConverter, MoreLikeThisHandlerTest, TestMergePolicyConfig, IndexReaderFactoryTest, HighlighterTest, TestQuerySenderNoQuery, TestCopyFieldCollectionResource, TestUpdate, SolrIndexConfigTest, UpdateRequestProcessorFactoryTest, ZkNodePropsTest, DOMUtilTest, UniqFieldsUpdateProcessorFactoryTest, TestFieldResource, FileBasedSpellCheckerTest, TestRTGBase, TestCodecSupport, SimpleFacetsTest, TestSolrXMLSerializer, TestElisionMultitermQuery, TestJmxMonitoredMap, TestStressVersions, TestPartialUpdateDeduplication, OverseerTest, TestSolr4Spatial, CoreContainerCoreInitFailuresTest, TestLuceneMatchVersion, TestBinaryField, RegexBoostProcessorTest, SortByFunctionTest, MultiTermTest, IndexSchemaTest, TestReversedWildcardFilterFactory, TestLMJelinekMercerSimilarityFactory, ClusterStateTest, TestComponentsName, BadIndexSchemaTest, TestNumberUtils, TestStressLucene, BasicDistributedZk2Test, EchoParamsTest, TestDFRSimilarityFactory, TestRecovery, TermVectorComponentDistributedTest, TestRandomDVFaceting, SpellPossibilityIteratorTest, NumericFieldsTest, FullSolrCloudDistribCmdsTest, ShardRoutingTest, TermsComponentTest, TestZkChroot, DisMaxRequestHandlerTest, SuggesterTest, TestFieldTypeResource, SolrCoreCheckLockOnStartupTest, TestPostingsSolrHighlighter, SliceStateUpdateTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 137.76s, 1 test, 1 failure <<< FAILURES!
[...truncated 427 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 268 suites, 1130 tests, 1 error, 1 failure, 9 ignored (3 assumptions)
Total time: 37 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4586 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4586/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([78264521D32C9F79:F9C0CB39A473FF45]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9216 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4] 2> 0 T2146 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /kmax/u
[junit4:junit4] 2> 3 T2146 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487
[junit4:junit4] 2> 4 T2146 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T2147 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T2147 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T2147 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T2147 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 5 T2147 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T2147 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-1362709173487/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T2146 oasc.ZkTestServer.run start zk server on port:59123
[junit4:junit4] 2> 105 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@266e0c36
[junit4:junit4] 2> 105 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 106 T2152 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T2152 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 106 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48223
[junit4:junit4] 2> 106 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48223
[junit4:junit4] 2> 107 T2150 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 776 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20000 with negotiated timeout 10000 for client /127.0.0.1:48223
[junit4:junit4] 2> 776 T2152 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20000, negotiated timeout = 10000
[junit4:junit4] 2> 776 T2153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@266e0c36 name:ZooKeeperConnection Watcher:127.0.0.1:59123 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 777 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 777 T2146 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 780 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f20000
[junit4:junit4] 2> 781 T2153 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 781 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48223 which had sessionid 0x13d47cbd4f20000
[junit4:junit4] 2> 781 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f20000 closed
[junit4:junit4] 2> 782 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@28a9e68b
[junit4:junit4] 2> 783 T2154 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 782 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 783 T2154 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 783 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48225
[junit4:junit4] 2> 784 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48225
[junit4:junit4] 2> 784 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20001 with negotiated timeout 10000 for client /127.0.0.1:48225
[junit4:junit4] 2> 784 T2154 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20001, negotiated timeout = 10000
[junit4:junit4] 2> 785 T2155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28a9e68b name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 785 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 785 T2146 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 788 T2146 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 790 T2146 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 791 T2146 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 805 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 805 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 808 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 808 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 810 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 811 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 812 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 813 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 814 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 815 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 817 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 817 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 819 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 819 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 821 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 821 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 823 T2146 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 823 T2146 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 825 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f20001
[junit4:junit4] 2> 825 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48225 which had sessionid 0x13d47cbd4f20001
[junit4:junit4] 2> 825 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f20001 closed
[junit4:junit4] 2> 825 T2155 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 880 T2146 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 884 T2146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52140
[junit4:junit4] 2> 884 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 884 T2146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 885 T2146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362709174310
[junit4:junit4] 2> 885 T2146 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362709174310/solr.xml
[junit4:junit4] 2> 885 T2146 oasc.CoreContainer.<init> New CoreContainer 1555287506
[junit4:junit4] 2> 886 T2146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362709174310/'
[junit4:junit4] 2> 886 T2146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362709174310/'
[junit4:junit4] 2> 900 T2146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 900 T2146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 901 T2146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 901 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 901 T2146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 902 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 902 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 902 T2146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 902 T2146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 903 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 908 T2146 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 916 T2146 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59123/solr
[junit4:junit4] 2> 916 T2146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 917 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@34b2c8bb
[junit4:junit4] 2> 918 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 918 T2165 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 918 T2165 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 919 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48226
[junit4:junit4] 2> 919 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48226
[junit4:junit4] 2> 920 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20002 with negotiated timeout 20000 for client /127.0.0.1:48226
[junit4:junit4] 2> 920 T2165 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20002, negotiated timeout = 20000
[junit4:junit4] 2> 920 T2166 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34b2c8bb name:ZooKeeperConnection Watcher:127.0.0.1:59123 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 920 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 921 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f20002
[junit4:junit4] 2> 922 T2166 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 922 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48226 which had sessionid 0x13d47cbd4f20002
[junit4:junit4] 2> 922 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f20002 closed
[junit4:junit4] 2> 922 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 924 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7debf041
[junit4:junit4] 2> 925 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 925 T2167 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 926 T2167 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 926 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48227
[junit4:junit4] 2> 926 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48227
[junit4:junit4] 2> 926 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20003 with negotiated timeout 20000 for client /127.0.0.1:48227
[junit4:junit4] 2> 926 T2167 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20003, negotiated timeout = 20000
[junit4:junit4] 2> 927 T2168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7debf041 name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 927 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 928 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 930 T2146 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 931 T2146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52140_kmax%2Fu
[junit4:junit4] 2> 932 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52140_kmax%2Fu Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52140_kmax%2Fu
[junit4:junit4] 2> 932 T2146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52140_kmax%2Fu
[junit4:junit4] 2> 934 T2146 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 937 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 937 T2146 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 940 T2146 oasc.Overseer.start Overseer (id=89306508393840643-127.0.0.1:52140_kmax%2Fu-n_0000000000) starting
[junit4:junit4] 2> 941 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 942 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 943 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 943 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 944 T2170 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 945 T2146 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 946 T2146 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 947 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 949 T2169 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 951 T2146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 951 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 951 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 954 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 954 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6ba6131b
[junit4:junit4] 2> 955 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 955 T2171 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 955 T2171 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 955 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48228
[junit4:junit4] 2> 955 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48228
[junit4:junit4] 2> 956 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20004 with negotiated timeout 10000 for client /127.0.0.1:48228
[junit4:junit4] 2> 956 T2171 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20004, negotiated timeout = 10000
[junit4:junit4] 2> 956 T2172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ba6131b name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 957 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 957 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 959 T2146 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1011 T2146 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1013 T2146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33473
[junit4:junit4] 2> 1014 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1015 T2146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1015 T2146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443
[junit4:junit4] 2> 1015 T2146 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/solr.xml
[junit4:junit4] 2> 1015 T2146 oasc.CoreContainer.<init> New CoreContainer 1255811316
[junit4:junit4] 2> 1016 T2146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/'
[junit4:junit4] 2> 1016 T2146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/'
[junit4:junit4] 2> 1030 T2146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1031 T2146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1031 T2146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1032 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1032 T2146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1032 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1032 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1033 T2146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1033 T2146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1033 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1038 T2146 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1046 T2146 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59123/solr
[junit4:junit4] 2> 1047 T2146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1047 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6d051d44
[junit4:junit4] 2> 1048 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1048 T2182 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1049 T2182 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 1049 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48229
[junit4:junit4] 2> 1049 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48229
[junit4:junit4] 2> 1050 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20005 with negotiated timeout 20000 for client /127.0.0.1:48229
[junit4:junit4] 2> 1050 T2182 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20005, negotiated timeout = 20000
[junit4:junit4] 2> 1050 T2183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d051d44 name:ZooKeeperConnection Watcher:127.0.0.1:59123 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1051 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1052 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f20005
[junit4:junit4] 2> 1052 T2183 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1052 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48229 which had sessionid 0x13d47cbd4f20005
[junit4:junit4] 2> 1052 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f20005 closed
[junit4:junit4] 2> 1053 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1055 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@30f7cf5d
[junit4:junit4] 2> 1056 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1056 T2184 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1056 T2184 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 1056 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48230
[junit4:junit4] 2> 1057 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48230
[junit4:junit4] 2> 1057 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20006 with negotiated timeout 20000 for client /127.0.0.1:48230
[junit4:junit4] 2> 1057 T2184 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20006, negotiated timeout = 20000
[junit4:junit4] 2> 1058 T2185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30f7cf5d name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1058 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1059 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:create cxid:0x1 zxid:0x2e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1059 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:create cxid:0x2 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1061 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2064 T2146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33473_kmax%2Fu
[junit4:junit4] 2> 2065 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:delete cxid:0xb zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33473_kmax%2Fu Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33473_kmax%2Fu
[junit4:junit4] 2> 2066 T2146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33473_kmax%2Fu
[junit4:junit4] 2> 2068 T2168 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2069 T2172 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2069 T2185 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2073 T2146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 2073 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2073 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2127 T2146 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 2129 T2146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39443
[junit4:junit4] 2> 2130 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2130 T2146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2131 T2146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559
[junit4:junit4] 2> 2131 T2146 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/solr.xml
[junit4:junit4] 2> 2131 T2146 oasc.CoreContainer.<init> New CoreContainer 91610060
[junit4:junit4] 2> 2131 T2146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/'
[junit4:junit4] 2> 2132 T2146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/'
[junit4:junit4] 2> 2157 T2146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2157 T2146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2157 T2146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2158 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2158 T2146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2158 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2158 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2159 T2146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2159 T2146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2159 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2164 T2146 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2172 T2146 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59123/solr
[junit4:junit4] 2> 2173 T2146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2173 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@18709bd
[junit4:junit4] 2> 2174 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2174 T2195 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2175 T2195 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 2175 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48231
[junit4:junit4] 2> 2175 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48231
[junit4:junit4] 2> 2176 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20007 with negotiated timeout 20000 for client /127.0.0.1:48231
[junit4:junit4] 2> 2176 T2195 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20007, negotiated timeout = 20000
[junit4:junit4] 2> 2176 T2196 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18709bd name:ZooKeeperConnection Watcher:127.0.0.1:59123 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2176 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2177 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f20007
[junit4:junit4] 2> 2178 T2196 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2178 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48231 which had sessionid 0x13d47cbd4f20007
[junit4:junit4] 2> 2178 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f20007 closed
[junit4:junit4] 2> 2178 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2180 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4049bf48
[junit4:junit4] 2> 2181 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2181 T2197 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2181 T2197 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 2181 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48232
[junit4:junit4] 2> 2182 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48232
[junit4:junit4] 2> 2182 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20008 with negotiated timeout 20000 for client /127.0.0.1:48232
[junit4:junit4] 2> 2182 T2197 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20008, negotiated timeout = 20000
[junit4:junit4] 2> 2183 T2198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4049bf48 name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2183 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2183 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20008 type:create cxid:0x1 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2184 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20008 type:create cxid:0x2 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2186 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3188 T2146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39443_kmax%2Fu
[junit4:junit4] 2> 3189 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20008 type:delete cxid:0xb zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39443_kmax%2Fu Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39443_kmax%2Fu
[junit4:junit4] 2> 3190 T2146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39443_kmax%2Fu
[junit4:junit4] 2> 3192 T2172 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3192 T2198 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3192 T2168 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3193 T2185 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3196 T2146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3197 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3197 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3253 T2146 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3255 T2146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35978
[junit4:junit4] 2> 3256 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3256 T2146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3257 T2146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684
[junit4:junit4] 2> 3257 T2146 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/solr.xml
[junit4:junit4] 2> 3257 T2146 oasc.CoreContainer.<init> New CoreContainer 421691031
[junit4:junit4] 2> 3257 T2146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/'
[junit4:junit4] 2> 3258 T2146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/'
[junit4:junit4] 2> 3272 T2146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3272 T2146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3272 T2146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3273 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3273 T2146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3273 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3274 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3274 T2146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3274 T2146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3274 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3279 T2146 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3287 T2146 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59123/solr
[junit4:junit4] 2> 3288 T2146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3288 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7a24823b
[junit4:junit4] 2> 3289 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3289 T2208 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3290 T2208 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 3290 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48233
[junit4:junit4] 2> 3290 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48233
[junit4:junit4] 2> 3291 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f20009 with negotiated timeout 20000 for client /127.0.0.1:48233
[junit4:junit4] 2> 3291 T2208 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f20009, negotiated timeout = 20000
[junit4:junit4] 2> 3291 T2209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a24823b name:ZooKeeperConnection Watcher:127.0.0.1:59123 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3291 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3292 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f20009
[junit4:junit4] 2> 3293 T2209 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3293 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48233 which had sessionid 0x13d47cbd4f20009
[junit4:junit4] 2> 3293 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f20009 closed
[junit4:junit4] 2> 3293 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3295 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b18ef76
[junit4:junit4] 2> 3296 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3296 T2210 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3297 T2210 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 3297 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48234
[junit4:junit4] 2> 3297 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48234
[junit4:junit4] 2> 3298 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f2000a with negotiated timeout 20000 for client /127.0.0.1:48234
[junit4:junit4] 2> 3298 T2210 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f2000a, negotiated timeout = 20000
[junit4:junit4] 2> 3298 T2211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b18ef76 name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3298 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3299 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f2000a type:create cxid:0x1 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3299 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f2000a type:create cxid:0x2 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3301 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4303 T2146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35978_kmax%2Fu
[junit4:junit4] 2> 4304 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f2000a type:delete cxid:0xb zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35978_kmax%2Fu Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35978_kmax%2Fu
[junit4:junit4] 2> 4305 T2146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35978_kmax%2Fu
[junit4:junit4] 2> 4307 T2172 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4307 T2168 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4307 T2198 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4307 T2185 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4307 T2211 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4311 T2146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 4311 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4312 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4364 T2146 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4367 T2146 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41383
[junit4:junit4] 2> 4368 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4368 T2146 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4368 T2146 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362709177798
[junit4:junit4] 2> 4369 T2146 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362709177798/solr.xml
[junit4:junit4] 2> 4369 T2146 oasc.CoreContainer.<init> New CoreContainer 1739188682
[junit4:junit4] 2> 4369 T2146 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362709177798/'
[junit4:junit4] 2> 4369 T2146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362709177798/'
[junit4:junit4] 2> 4384 T2146 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4384 T2146 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4384 T2146 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4385 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4385 T2146 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4385 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4385 T2146 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4386 T2146 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4386 T2146 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4386 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4391 T2146 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4411 T2146 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59123/solr
[junit4:junit4] 2> 4411 T2146 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4412 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@32738d63
[junit4:junit4] 2> 4412 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4413 T2221 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4413 T2221 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 4414 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48235
[junit4:junit4] 2> 4414 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48235
[junit4:junit4] 2> 4414 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f2000b with negotiated timeout 20000 for client /127.0.0.1:48235
[junit4:junit4] 2> 4415 T2221 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f2000b, negotiated timeout = 20000
[junit4:junit4] 2> 4415 T2222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32738d63 name:ZooKeeperConnection Watcher:127.0.0.1:59123 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4415 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4416 T2151 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d47cbd4f2000b
[junit4:junit4] 2> 4417 T2222 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4417 T2148 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48235 which had sessionid 0x13d47cbd4f2000b
[junit4:junit4] 2> 4417 T2146 oaz.ZooKeeper.close Session: 0x13d47cbd4f2000b closed
[junit4:junit4] 2> 4417 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4420 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6270187e
[junit4:junit4] 2> 4420 T2223 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4420 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4421 T2223 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 4421 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48236
[junit4:junit4] 2> 4421 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48236
[junit4:junit4] 2> 4422 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f2000c with negotiated timeout 20000 for client /127.0.0.1:48236
[junit4:junit4] 2> 4422 T2223 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f2000c, negotiated timeout = 20000
[junit4:junit4] 2> 4422 T2224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6270187e name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4422 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4423 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f2000c type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4424 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f2000c type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4426 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5428 T2146 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41383_kmax%2Fu
[junit4:junit4] 2> 5429 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f2000c type:delete cxid:0xb zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41383_kmax%2Fu Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41383_kmax%2Fu
[junit4:junit4] 2> 5430 T2146 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41383_kmax%2Fu
[junit4:junit4] 2> 5433 T2198 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5433 T2168 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5433 T2172 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5433 T2224 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5433 T2211 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5433 T2185 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5437 T2146 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 5437 T2146 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5438 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5440 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5443 T2178 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/unloadcollection1
[junit4:junit4] 2> 5443 T2178 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 5444 T2178 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4] 2> 5444 T2178 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 5445 T2178 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 5445 T2178 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4] 2> 5447 T2178 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 5448 T2178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/unloadcollection1/'
[junit4:junit4] 2> 5469 T2178 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 5497 T2178 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5498 T2178 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5501 T2178 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5804 T2178 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5809 T2178 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5811 T2178 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5823 T2178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5826 T2178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5838 T2178 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5840 T2178 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5840 T2178 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5840 T2178 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5841 T2178 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5841 T2178 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5842 T2178 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n/
[junit4:junit4] 2> 5842 T2178 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28a2106a
[junit4:junit4] 2> 5842 T2178 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5843 T2178 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n forceNew: false
[junit4:junit4] 2> 5843 T2178 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n/index/
[junit4:junit4] 2> 5844 T2178 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5844 T2178 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n/index forceNew: false
[junit4:junit4] 2> 5845 T2178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5846 T2178 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5847 T2178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5847 T2178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5848 T2178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5848 T2178 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5848 T2178 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5849 T2178 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5849 T2178 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5849 T2178 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5850 T2178 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5852 T2178 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5854 T2178 oass.SolrIndexSearcher.<init> Opening Searcher@24e7b241 main
[junit4:junit4] 2> 5854 T2178 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n/tlog
[junit4:junit4] 2> 5854 T2178 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5855 T2178 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5857 T2225 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@24e7b241 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5858 T2178 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4] 2> 5859 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:create cxid:0x40 zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 6958 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6959 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33473_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33473/kmax/u",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 6959 T2169 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4] 2> 6959 T2169 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6959 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20003 type:create cxid:0x46 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 6964 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6964 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6965 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6965 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6964 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6964 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7861 T2178 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4] 2> 7862 T2178 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:33473/kmax/u collection:unloadcollection shard:shard1
[junit4:junit4] 2> 7863 T2178 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 2> 7868 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:delete cxid:0x51 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4] 2> 7869 T2178 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7869 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:create cxid:0x52 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7870 T2178 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7870 T2178 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7871 T2178 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33473/kmax/u/unloadcollection1/
[junit4:junit4] 2> 7871 T2178 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7871 T2178 oasc.SyncStrategy.syncToMe http://127.0.0.1:33473/kmax/u/unloadcollection1/ has no replicas
[junit4:junit4] 2> 7871 T2178 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33473/kmax/u/unloadcollection1/
[junit4:junit4] 2> 7872 T2178 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4] 2> 7876 T2151 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d47cbd4f20006 type:create cxid:0x5c zxid:0x5e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8469 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8476 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8476 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8476 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8476 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8476 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8476 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8480 T2178 oasc.ZkController.register We are http://127.0.0.1:33473/kmax/u/unloadcollection1/ and leader is http://127.0.0.1:33473/kmax/u/unloadcollection1/
[junit4:junit4] 2> 8481 T2178 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:33473/kmax/u
[junit4:junit4] 2> 8481 T2178 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8481 T2178 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4] 2> 8483 T2178 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8484 T2178 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/solr.xml
[junit4:junit4] 2> 8490 T2178 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362709174443/solr.xml
[junit4:junit4] 2> 8491 T2178 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=unloadcollection1&action=CREATE&numShards=1&collection=unloadcollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709178926unloadcollection1_1n&version=2&wt=javabin} status=0 QTime=3048
[junit4:junit4] 2> 8492 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 8493 T2146 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59123/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@722817ff
[junit4:junit4] 2> 8494 T2146 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8494 T2226 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59123. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8495 T2226 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59123, initiating session
[junit4:junit4] 2> 8495 T2148 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48240
[junit4:junit4] 2> 8495 T2148 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48240
[junit4:junit4] 2> 8496 T2150 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d47cbd4f2000d with negotiated timeout 10000 for client /127.0.0.1:48240
[junit4:junit4] 2> 8496 T2226 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59123, sessionid = 0x13d47cbd4f2000d, negotiated timeout = 10000
[junit4:junit4] 2> 8496 T2227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@722817ff name:ZooKeeperConnection Watcher:127.0.0.1:59123/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8497 T2146 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8498 T2146 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8500 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8501 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8504 T2191 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/unloadcollection2
[junit4:junit4] 2> 8504 T2191 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 8505 T2191 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 8505 T2191 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 8506 T2191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/unloadcollection2/'
[junit4:junit4] 2> 8530 T2191 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 8560 T2191 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 8561 T2191 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 8564 T2191 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8887 T2191 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8892 T2191 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8894 T2191 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8906 T2191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8909 T2191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8911 T2191 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8912 T2191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8913 T2191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8913 T2191 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8914 T2191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8914 T2191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8914 T2191 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n/
[junit4:junit4] 2> 8915 T2191 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28a2106a
[junit4:junit4] 2> 8915 T2191 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8916 T2191 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n forceNew: false
[junit4:junit4] 2> 8916 T2191 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n/index/
[junit4:junit4] 2> 8916 T2191 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8917 T2191 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n/index forceNew: false
[junit4:junit4] 2> 8918 T2191 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@f285d84 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704c577a; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8918 T2191 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8919 T2191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8920 T2191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8920 T2191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8921 T2191 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8921 T2191 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8921 T2191 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8921 T2191 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8922 T2191 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8922 T2191 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8924 T2191 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8926 T2191 oass.SolrIndexSearcher.<init> Opening Searcher@3bc7c37d main
[junit4:junit4] 2> 8926 T2191 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n/tlog
[junit4:junit4] 2> 8927 T2191 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8927 T2191 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8930 T2228 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@3bc7c37d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8930 T2191 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4] 2> 8931 T2191 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9981 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9982 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33473_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33473/kmax/u",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 9985 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:39443_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39443/kmax/u",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 9985 T2169 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 9986 T2169 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9989 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9989 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9989 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9989 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9989 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9989 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9989 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10932 T2191 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4] 2> 10933 T2191 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:39443/kmax/u collection:unloadcollection shard:shard1
[junit4:junit4] 2> 10936 T2191 oasc.ZkController.register We are http://127.0.0.1:39443/kmax/u/unloadcollection2/ and leader is http://127.0.0.1:33473/kmax/u/unloadcollection1/
[junit4:junit4] 2> 10936 T2191 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:39443/kmax/u
[junit4:junit4] 2> 10937 T2191 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4] 2> 10937 T2191 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C82 name=unloadcollection2 org.apache.solr.core.SolrCore@fa35721 url=http://127.0.0.1:39443/kmax/u/unloadcollection2 node=127.0.0.1:39443_kmax%2Fu C82_STATE=coll:unloadcollection core:unloadcollection2 props:{state=down, core=unloadcollection2, node_name=127.0.0.1:39443_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:39443/kmax/u}
[junit4:junit4] 2> 10938 T2229 C82 P39443 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4] 2> 10938 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 10938 T2191 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10938 T2229 C82 P39443 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4] 2> 10939 T2229 C82 P39443 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10939 T2191 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/solr.xml
[junit4:junit4] 2> 10940 T2229 C82 P39443 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10944 T2191 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362709175559/solr.xml
[junit4:junit4] 2> 10945 T2191 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=unloadcollection2&action=CREATE&collection=unloadcollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n&version=2&wt=javabin} status=0 QTime=2441
[junit4:junit4] 2> 10946 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10947 T2146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 10948 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11494 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11495 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:39443_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39443/kmax/u",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 11515 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11515 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11515 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11515 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11516 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11516 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11516 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11944 T2180 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:39443_kmax%252Fu_unloadcollection2&state=recovering&core=unloadcollection1&action=PREPRECOVERY&checkLive=true&nodeName=127.0.0.1:39443_kmax%252Fu&version=2&wt=javabin&onlyIfLeader=true} status=0 QTime=1001
[junit4:junit4] 2> 11950 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12952 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C82_STATE=coll:unloadcollection core:unloadcollection2 props:{state=recovering, core=unloadcollection2, node_name=127.0.0.1:39443_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:39443/kmax/u, shard=shard1}
[junit4:junit4] 2> 13945 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33473/kmax/u/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4] 2> 13946 T2229 C82 P39443 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:39443/kmax/u START replicas=[http://127.0.0.1:33473/kmax/u/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 13946 T2229 C82 P39443 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 13947 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4] 2> 13947 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4] 2> 13947 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4] 2> 13947 T2229 C82 P39443 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 13947 T2229 C82 P39443 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33473/kmax/u/unloadcollection1/. core=unloadcollection2
[junit4:junit4] 2> 13948 T2229 C82 P39443 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C83 name=unloadcollection1 org.apache.solr.core.SolrCore@4b5ffe41 url=http://127.0.0.1:33473/kmax/u/unloadcollection1 node=127.0.0.1:33473_kmax%2Fu C83_STATE=coll:unloadcollection core:unloadcollection1 props:{state=active, core=unloadcollection1, node_name=127.0.0.1:33473_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:33473/kmax/u, shard=shard1, leader=true}
[junit4:junit4] 2> 13951 T2178 C83 P33473 REQ /get {getVersions=100&qt=/get&version=2&wt=javabin&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 13951 T2181 C83 P33473 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 13954 T2181 C83 P33473 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13954 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13954 T2181 C83 P33473 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13955 T2181 C83 P33473 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13956 T2181 C83 P33473 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13956 T2181 C83 P33473 oass.SolrIndexSearcher.<init> Opening Searcher@528e6e3f realtime
[junit4:junit4] 2> 13957 T2181 C83 P33473 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 13957 T2181 C83 P33473 /update {commit=true&waitSearcher=true&softCommit=false&commit_end_point=true&openSearcher=false&version=2&wt=javabin} {commit=} 0 6
[junit4:junit4] 2> 13958 T2229 C82 P39443 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13958 T2229 C82 P39443 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 13964 T2180 C83 P33473 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13964 T2180 C83 P33473 REQ /replication {command=indexversion&qt=/replication&version=2&wt=javabin} status=0 QTime=5
[junit4:junit4] 2> 13965 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 13965 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 13966 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 13968 T2178 C83 P33473 REQ /replication {command=filelist&qt=/replication&generation=2&version=2&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 13968 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 13969 T2229 C82 P39443 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709181987unloadcollection1_2n/index.20130308151947452 forceNew: false
[junit4:junit4] 2> 13970 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@65b5de09 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10a3801e) fullCopy=false
[junit4:junit4] 2> 13972 T2181 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=2&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 13973 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 13974 T2229 C82 P39443 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 13974 T2229 C82 P39443 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4] 2> 13975 T2229 C82 P39443 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@f285d84 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704c577a; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@f285d84 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704c577a; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13975 T2229 C82 P39443 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13976 T2229 C82 P39443 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 13976 T2229 C82 P39443 oass.SolrIndexSearcher.<init> Opening Searcher@471d1be main
[junit4:junit4] 2> 13976 T2228 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@471d1be main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 13977 T2229 C82 P39443 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@65b5de09 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10a3801e)
[junit4:junit4] 2> 13977 T2229 C82 P39443 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4] 2> 13977 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4] 2> 13977 T2229 C82 P39443 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4] 2> 13977 T2229 C82 P39443 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13978 T2229 C82 P39443 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4] 2> 14523 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14523 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:39443_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39443/kmax/u",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 14527 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14527 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14527 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14527 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14527 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14527 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14527 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14956 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14957 T2146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 14958 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C82_STATE=coll:unloadcollection core:unloadcollection2 props:{state=active, core=unloadcollection2, node_name=127.0.0.1:39443_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:39443/kmax/u, shard=shard1}
[junit4:junit4] 2> 14969 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[6 (1428904149983952896)]} 0 1
[junit4:junit4] 2> 14970 T2179 C83 P33473 /update {version=2&wt=javabin} {add=[6 (1428904149983952896)]} 0 8
[junit4:junit4] 2> 14975 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[7 (1428904149994438656)]} 0 1
[junit4:junit4] 2> 14975 T2180 C83 P33473 /update {version=2&wt=javabin} {add=[7 (1428904149994438656)]} 0 3
[junit4:junit4] 2> 14980 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[8 (1428904149999681536)]} 0 0
[junit4:junit4] 2> 14980 T2178 C83 P33473 /update {version=2&wt=javabin} {add=[8 (1428904149999681536)]} 0 3
[junit4:junit4] 2> 14983 T2181 C83 P33473 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14985 T2181 C83 P33473 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_3,generation=3,filenames=[_0.tim, segments_3, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> 14985 T2181 C83 P33473 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.tim, segments_3, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> 14986 T2181 C83 P33473 oass.SolrIndexSearcher.<init> Opening Searcher@447ad9df main
[junit4:junit4] 2> 14986 T2181 C83 P33473 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14987 T2225 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@447ad9df main{StandardDirectoryReader(segments_3:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 14987 T2181 C83 P33473 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:39443/kmax/u/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 14989 T2191 C82 P39443 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14992 T2191 C82 P39443 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@f285d84 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704c577a; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@f285d84 lockFactory=org.apache.lucene.store.NativeFSLockFactory@704c577a; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_3,generation=3,filenames=[_0.tim, segments_3, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> 14992 T2191 C82 P39443 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.tim, segments_3, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> 14993 T2191 C82 P39443 oass.SolrIndexSearcher.<init> Opening Searcher@466a175b main
[junit4:junit4] 2> 14993 T2191 C82 P39443 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14994 T2228 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@466a175b main{StandardDirectoryReader(segments_3:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 14994 T2191 C82 P39443 /update {commit=true&waitSearcher=true&softCommit=false&commit_end_point=true&expungeDeletes=false&version=2&wt=javabin} {commit=} 0 5
[junit4:junit4] 2> 14995 T2181 C83 P33473 /update {commit=true&waitSearcher=true&softCommit=false&version=2&wt=javabin} {commit=} 0 12
[junit4:junit4] 2> 14995 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14999 T2205 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/unloadcollection3
[junit4:junit4] 2> 14999 T2205 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 15000 T2205 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15000 T2205 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 15001 T2205 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/unloadcollection3/'
[junit4:junit4] 2> 15026 T2205 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 15063 T2205 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15064 T2205 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15068 T2205 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15373 T2205 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15379 T2205 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15381 T2205 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15392 T2205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15394 T2205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15397 T2205 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15398 T2205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15398 T2205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15398 T2205 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15399 T2205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15399 T2205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15400 T2205 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n/
[junit4:junit4] 2> 15400 T2205 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28a2106a
[junit4:junit4] 2> 15400 T2205 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15401 T2205 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n forceNew: false
[junit4:junit4] 2> 15401 T2205 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n/index/
[junit4:junit4] 2> 15401 T2205 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15402 T2205 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n/index forceNew: false
[junit4:junit4] 2> 15403 T2205 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@66688339 lockFactory=org.apache.lucene.store.NativeFSLockFactory@598e65c9; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15403 T2205 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15405 T2205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15405 T2205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15406 T2205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15406 T2205 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15406 T2205 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15407 T2205 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15407 T2205 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15407 T2205 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15408 T2205 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15410 T2205 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15412 T2205 oass.SolrIndexSearcher.<init> Opening Searcher@66c73ac3 main
[junit4:junit4] 2> 15412 T2205 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n/tlog
[junit4:junit4] 2> 15413 T2205 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15413 T2205 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15420 T2233 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@66c73ac3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15422 T2205 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4] 2> 15422 T2205 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16031 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16032 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:35978_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35978/kmax/u",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 16032 T2169 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 16032 T2169 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16037 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16037 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16037 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16037 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16037 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16037 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16037 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16424 T2205 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4] 2> 16424 T2205 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:35978/kmax/u collection:unloadcollection shard:shard1
[junit4:junit4] 2> 16427 T2205 oasc.ZkController.register We are http://127.0.0.1:35978/kmax/u/unloadcollection3/ and leader is http://127.0.0.1:33473/kmax/u/unloadcollection1/
[junit4:junit4] 2> 16427 T2205 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:35978/kmax/u
[junit4:junit4] 2> 16428 T2205 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4] 2> 16428 T2205 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C84 name=unloadcollection3 org.apache.solr.core.SolrCore@3ea16039 url=http://127.0.0.1:35978/kmax/u/unloadcollection3 node=127.0.0.1:35978_kmax%2Fu C84_STATE=coll:unloadcollection core:unloadcollection3 props:{state=down, core=unloadcollection3, node_name=127.0.0.1:35978_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:35978/kmax/u}
[junit4:junit4] 2> 16429 T2234 C84 P35978 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4] 2> 16430 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16430 T2234 C84 P35978 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4] 2> 16430 T2205 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16430 T2234 C84 P35978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16431 T2205 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/solr.xml
[junit4:junit4] 2> 16431 T2234 C84 P35978 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16437 T2205 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362709176684/solr.xml
[junit4:junit4] 2> 16438 T2205 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=unloadcollection3&action=CREATE&collection=unloadcollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n&version=2&wt=javabin} status=0 QTime=1440
[junit4:junit4] 2> 16439 T2146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 16439 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17441 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17542 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17542 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:35978_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35978/kmax/u",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 17548 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17548 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17548 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17548 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17548 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17548 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17548 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18435 T2178 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:35978_kmax%252Fu_unloadcollection3&state=recovering&core=unloadcollection1&action=PREPRECOVERY&checkLive=true&nodeName=127.0.0.1:35978_kmax%252Fu&version=2&wt=javabin&onlyIfLeader=true} status=0 QTime=2000
[junit4:junit4] 2> 18443 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19120 T1159 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4] 2> 19445 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C84_STATE=coll:unloadcollection core:unloadcollection3 props:{state=recovering, core=unloadcollection3, node_name=127.0.0.1:35978_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:35978/kmax/u, shard=shard1}
[junit4:junit4] 2> 20436 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33473/kmax/u/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4] 2> 20437 T2234 C84 P35978 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:35978/kmax/u START replicas=[http://127.0.0.1:33473/kmax/u/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 20437 T2234 C84 P35978 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20437 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4] 2> 20437 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4] 2> 20437 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4] 2> 20438 T2234 C84 P35978 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20438 T2234 C84 P35978 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33473/kmax/u/unloadcollection1/. core=unloadcollection3
[junit4:junit4] 2> 20438 T2234 C84 P35978 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20439 T2180 C83 P33473 REQ /get {getVersions=100&qt=/get&version=2&wt=javabin&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 20441 T2181 C83 P33473 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20442 T2181 C83 P33473 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_3,generation=3,filenames=[_0.tim, segments_3, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@3ffbff5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4efb256b; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_4,generation=4,filenames=[_0.tim, segments_4, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> 20442 T2181 C83 P33473 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.tim, segments_4, _0.fdx, _0_nrm.cfs, _0.fnm, _0.si, _0.frq, _0.prx, _0.tip, _0_nrm.cfe, _0.fdt]
[junit4:junit4] 2> 20443 T2181 C83 P33473 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20443 T2181 C83 P33473 /update {commit=true&waitSearcher=true&softCommit=false&commit_end_point=true&openSearcher=false&version=2&wt=javabin} {commit=} 0 2
[junit4:junit4] 2> 20444 T2234 C84 P35978 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20444 T2234 C84 P35978 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20446 T2180 C83 P33473 REQ /replication {command=indexversion&qt=/replication&version=2&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 20446 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 20446 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20446 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20446 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20448 T2178 C83 P33473 REQ /replication {command=filelist&qt=/replication&generation=4&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 20449 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 11
[junit4:junit4] 2> 20451 T2234 C84 P35978 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-UnloadDistributedZkTest-1362709173487/1362709188481unloadcollection_3n/index.20130308151953933 forceNew: false
[junit4:junit4] 2> 20451 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@310f3157 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cae1893) fullCopy=false
[junit4:junit4] 2> 20453 T2181 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.tim&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20456 T2179 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=segments_4&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20469 T2180 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.fnm&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20472 T2178 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0_nrm.cfs&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20474 T2181 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.fdx&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20477 T2179 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.si&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20479 T2180 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.prx&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20482 T2178 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.frq&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20484 T2181 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0_nrm.cfe&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20487 T2179 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.tip&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20490 T2180 C83 P33473 REQ /replication {command=filecontent&qt=/replication&checksum=true&generation=4&file=_0.fdt&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 20490 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20492 T2234 C84 P35978 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20492 T2234 C84 P35978 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4] 2> 20493 T2234 C84 P35978 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@66688339 lockFactory=org.apache.lucene.store.NativeFSLockFactory@598e65c9; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@66688339 lockFactory=org.apache.lucene.store.NativeFSLockFactory@598e65c9; maxCacheMB=0.640625 maxMergeSizeMB=0.22265625)),segFN=segments_4,generation=4,filenames=[_0.tim, segments_4, _0.fnm, _0_nrm.cfs, _0.fdx, _0.si, _0.prx, _0.frq, _0_nrm.cfe, _0.tip, _0.fdt]
[junit4:junit4] 2> 20493 T2234 C84 P35978 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.tim, segments_4, _0.fnm, _0_nrm.cfs, _0.fdx, _0.si, _0.prx, _0.frq, _0_nrm.cfe, _0.tip, _0.fdt]
[junit4:junit4] 2> 20494 T2234 C84 P35978 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20494 T2234 C84 P35978 oass.SolrIndexSearcher.<init> Opening Searcher@4e4af650 main
[junit4:junit4] 2> 20495 T2233 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@4e4af650 main{StandardDirectoryReader(segments_4:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 20495 T2234 C84 P35978 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@310f3157 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cae1893)
[junit4:junit4] 2> 20495 T2234 C84 P35978 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4] 2> 20495 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4] 2> 20496 T2234 C84 P35978 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4] 2> 20496 T2234 C84 P35978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20497 T2234 C84 P35978 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4] 2> 20554 T2169 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20555 T2169 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:35978_kmax%2Fu",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35978/kmax/u",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state"}
[junit4:junit4] 2> 20565 T2168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20565 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20565 T2172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20565 T2185 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20565 T2211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20565 T2198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20565 T2224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21328 T1174 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4] 2> 21448 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21449 T2146 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 21449 T2146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C84_STATE=coll:unloadcollection core:unloadcollection3 props:{state=active, core=unloadcollection3, node_name=127.0.0.1:35978_kmax%2Fu, collection=unloadcollection, base_url=http://127.0.0.1:35978/kmax/u, shard=shard1}
[junit4:junit4] 2> 21462 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[20 (1428904156795502592)]} 0 1
[junit4:junit4] 2> 21463 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[20 (1428904156795502592)]} 0 2
[junit4:junit4] 2> 21463 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[20 (1428904156795502592)]} 0 5
[junit4:junit4] 2> 21464 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[20]} 0 8
[junit4:junit4] 2> 21470 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[21 (1428904156805988352)]} 0 0
[junit4:junit4] 2> 21470 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[21 (1428904156805988352)]} 0 0
[junit4:junit4] 2> 21471 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[21 (1428904156805988352)]} 0 4
[junit4:junit4] 2> 21472 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[21]} 0 6
[junit4:junit4] 2> 21478 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[22 (1428904156813328384)]} 0 0
[junit4:junit4] 2> 21478 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[22 (1428904156813328384)]} 0 0
[junit4:junit4] 2> 21479 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[22 (1428904156813328384)]} 0 4
[junit4:junit4] 2> 21480 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[22]} 0 6
[junit4:junit4] 2> 21486 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[23 (1428904156822765568)]} 0 0
[junit4:junit4] 2> 21486 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[23 (1428904156822765568)]} 0 0
[junit4:junit4] 2> 21487 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[23 (1428904156822765568)]} 0 3
[junit4:junit4] 2> 21487 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[23]} 0 5
[junit4:junit4] 2> 21494 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[24 (1428904156830105600)]} 0 1
[junit4:junit4] 2> 21494 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[24 (1428904156830105600)]} 0 1
[junit4:junit4] 2> 21495 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[24 (1428904156830105600)]} 0 4
[junit4:junit4] 2> 21495 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[24]} 0 6
[junit4:junit4] 2> 21501 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[25 (1428904156838494208)]} 0 0
[junit4:junit4] 2> 21501 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[25 (1428904156838494208)]} 0 0
[junit4:junit4] 2> 21502 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[25 (1428904156838494208)]} 0 3
[junit4:junit4] 2> 21502 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[25]} 0 5
[junit4:junit4] 2> 21509 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[26 (1428904156845834240)]} 0 0
[junit4:junit4] 2> 21509 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[26 (1428904156845834240)]} 0 0
[junit4:junit4] 2> 21510 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[26 (1428904156845834240)]} 0 4
[junit4:junit4] 2> 21510 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[26]} 0 5
[junit4:junit4] 2> 21517 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[27 (1428904156854222848)]} 0 0
[junit4:junit4] 2> 21517 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[27 (1428904156854222848)]} 0 0
[junit4:junit4] 2> 21518 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[27 (1428904156854222848)]} 0 4
[junit4:junit4] 2> 21518 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[27]} 0 5
[junit4:junit4] 2> 21525 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[28 (1428904156862611456)]} 0 1
[junit4:junit4] 2> 21525 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[28 (1428904156862611456)]} 0 1
[junit4:junit4] 2> 21525 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[28 (1428904156862611456)]} 0 3
[junit4:junit4] 2> 21526 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[28]} 0 6
[junit4:junit4] 2> 21532 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[29 (1428904156871000064)]} 0 0
[junit4:junit4] 2> 21532 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[29 (1428904156871000064)]} 0 0
[junit4:junit4] 2> 21533 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[29 (1428904156871000064)]} 0 3
[junit4:junit4] 2> 21533 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[29]} 0 5
[junit4:junit4] 2> 21540 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[30 (1428904156878340096)]} 0 1
[junit4:junit4] 2> 21540 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[30 (1428904156878340096)]} 0 1
[junit4:junit4] 2> 21540 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[30 (1428904156878340096)]} 0 3
[junit4:junit4] 2> 21541 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[30]} 0 6
[junit4:junit4] 2> 21547 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[31 (1428904156886728704)]} 0 0
[junit4:junit4] 2> 21547 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[31 (1428904156886728704)]} 0 0
[junit4:junit4] 2> 21548 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[31 (1428904156886728704)]} 0 3
[junit4:junit4] 2> 21549 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[31]} 0 6
[junit4:junit4] 2> 21555 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[32 (1428904156895117312)]} 0 0
[junit4:junit4] 2> 21555 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[32 (1428904156895117312)]} 0 0
[junit4:junit4] 2> 21556 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[32 (1428904156895117312)]} 0 3
[junit4:junit4] 2> 21556 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[32]} 0 5
[junit4:junit4] 2> 21563 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[33 (1428904156902457344)]} 0 1
[junit4:junit4] 2> 21563 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[33 (1428904156902457344)]} 0 1
[junit4:junit4] 2> 21563 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[33 (1428904156902457344)]} 0 3
[junit4:junit4] 2> 21564 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[33]} 0 6
[junit4:junit4] 2> 21570 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[34 (1428904156910845952)]} 0 0
[junit4:junit4] 2> 21570 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[34 (1428904156910845952)]} 0 0
[junit4:junit4] 2> 21571 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[34 (1428904156910845952)]} 0 3
[junit4:junit4] 2> 21572 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[34]} 0 6
[junit4:junit4] 2> 21578 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[35 (1428904156919234560)]} 0 0
[junit4:junit4] 2> 21579 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[35 (1428904156919234560)]} 0 1
[junit4:junit4] 2> 21579 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[35 (1428904156919234560)]} 0 3
[junit4:junit4] 2> 21580 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[35]} 0 6
[junit4:junit4] 2> 21586 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[36 (1428904156927623168)]} 0 0
[junit4:junit4] 2> 21586 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[36 (1428904156927623168)]} 0 0
[junit4:junit4] 2> 21587 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[36 (1428904156927623168)]} 0 3
[junit4:junit4] 2> 21587 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[36]} 0 5
[junit4:junit4] 2> 21594 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[37 (1428904156934963200)]} 0 1
[junit4:junit4] 2> 21594 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[37 (1428904156934963200)]} 0 1
[junit4:junit4] 2> 21594 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[37 (1428904156934963200)]} 0 3
[junit4:junit4] 2> 21595 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[37]} 0 6
[junit4:junit4] 2> 21601 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[38 (1428904156943351808)]} 0 0
[junit4:junit4] 2> 21601 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[38 (1428904156943351808)]} 0 0
[junit4:junit4] 2> 21602 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[38 (1428904156943351808)]} 0 3
[junit4:junit4] 2> 21603 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[38]} 0 6
[junit4:junit4] 2> 21609 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[39 (1428904156951740416)]} 0 0
[junit4:junit4] 2> 21609 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[39 (1428904156951740416)]} 0 0
[junit4:junit4] 2> 21610 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[39 (1428904156951740416)]} 0 3
[junit4:junit4] 2> 21611 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[39]} 0 6
[junit4:junit4] 2> 21617 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[40 (1428904156960129024)]} 0 0
[junit4:junit4] 2> 21617 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[40 (1428904156960129024)]} 0 0
[junit4:junit4] 2> 21618 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[40 (1428904156960129024)]} 0 3
[junit4:junit4] 2> 21618 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[40]} 0 5
[junit4:junit4] 2> 21624 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[41 (1428904156967469056)]} 0 0
[junit4:junit4] 2> 21624 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[41 (1428904156967469056)]} 0 0
[junit4:junit4] 2> 21625 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[41 (1428904156967469056)]} 0 3
[junit4:junit4] 2> 21626 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[41]} 0 6
[junit4:junit4] 2> 21632 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[42 (1428904156975857664)]} 0 0
[junit4:junit4] 2> 21632 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[42 (1428904156975857664)]} 0 0
[junit4:junit4] 2> 21633 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[42 (1428904156975857664)]} 0 3
[junit4:junit4] 2> 21633 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[42]} 0 5
[junit4:junit4] 2> 21640 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[43 (1428904156984246272)]} 0 0
[junit4:junit4] 2> 21640 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[43 (1428904156984246272)]} 0 0
[junit4:junit4] 2> 21641 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[43 (1428904156984246272)]} 0 4
[junit4:junit4] 2> 21641 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[43]} 0 5
[junit4:junit4] 2> 21648 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[44 (1428904156991586304)]} 0 1
[junit4:junit4] 2> 21648 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[44 (1428904156991586304)]} 0 1
[junit4:junit4] 2> 21648 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[44 (1428904156991586304)]} 0 3
[junit4:junit4] 2> 21649 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[44]} 0 6
[junit4:junit4] 2> 21655 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[45 (1428904156999974912)]} 0 0
[junit4:junit4] 2> 21655 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[45 (1428904156999974912)]} 0 0
[junit4:junit4] 2> 21656 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[45 (1428904156999974912)]} 0 3
[junit4:junit4] 2> 21657 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[45]} 0 6
[junit4:junit4] 2> 21663 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[46 (1428904157008363520)]} 0 0
[junit4:junit4] 2> 21663 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[46 (1428904157008363520)]} 0 0
[junit4:junit4] 2> 21664 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[46 (1428904157008363520)]} 0 4
[junit4:junit4] 2> 21664 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[46]} 0 5
[junit4:junit4] 2> 21671 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[47 (1428904157015703552)]} 0 1
[junit4:junit4] 2> 21671 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[47 (1428904157015703552)]} 0 1
[junit4:junit4] 2> 21671 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[47 (1428904157015703552)]} 0 3
[junit4:junit4] 2> 21672 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[47]} 0 6
[junit4:junit4] 2> 21678 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[48 (1428904157024092160)]} 0 0
[junit4:junit4] 2> 21679 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[48 (1428904157024092160)]} 0 1
[junit4:junit4] 2> 21679 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[48 (1428904157024092160)]} 0 3
[junit4:junit4] 2> 21680 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[48]} 0 6
[junit4:junit4] 2> 21686 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[49 (1428904157032480768)]} 0 0
[junit4:junit4] 2> 21686 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[49 (1428904157032480768)]} 0 0
[junit4:junit4] 2> 21687 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[49 (1428904157032480768)]} 0 3
[junit4:junit4] 2> 21687 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[49]} 0 5
[junit4:junit4] 2> 21694 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[50 (1428904157039820800)]} 0 1
[junit4:junit4] 2> 21694 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[50 (1428904157039820800)]} 0 1
[junit4:junit4] 2> 21695 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[50 (1428904157039820800)]} 0 4
[junit4:junit4] 2> 21695 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[50]} 0 6
[junit4:junit4] 2> 21702 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[51 (1428904157048209408)]} 0 1
[junit4:junit4] 2> 21702 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[51 (1428904157048209408)]} 0 1
[junit4:junit4] 2> 21702 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[51 (1428904157048209408)]} 0 3
[junit4:junit4] 2> 21703 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[51]} 0 6
[junit4:junit4] 2> 21709 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[52 (1428904157056598016)]} 0 0
[junit4:junit4] 2> 21709 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[52 (1428904157056598016)]} 0 0
[junit4:junit4] 2> 21710 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[52 (1428904157056598016)]} 0 3
[junit4:junit4] 2> 21711 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[52]} 0 6
[junit4:junit4] 2> 21717 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[53 (1428904157064986624)]} 0 0
[junit4:junit4] 2> 21717 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[53 (1428904157064986624)]} 0 0
[junit4:junit4] 2> 21718 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[53 (1428904157064986624)]} 0 3
[junit4:junit4] 2> 21718 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[53]} 0 5
[junit4:junit4] 2> 21725 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[54 (1428904157072326656)]} 0 1
[junit4:junit4] 2> 21725 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[54 (1428904157072326656)]} 0 0
[junit4:junit4] 2> 21726 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[54 (1428904157072326656)]} 0 4
[junit4:junit4] 2> 21726 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[54]} 0 6
[junit4:junit4] 2> 21733 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[55 (1428904157080715264)]} 0 1
[junit4:junit4] 2> 21733 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[55 (1428904157080715264)]} 0 1
[junit4:junit4] 2> 21733 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[55 (1428904157080715264)]} 0 3
[junit4:junit4] 2> 21734 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[55]} 0 6
[junit4:junit4] 2> 21740 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[56 (1428904157089103872)]} 0 0
[junit4:junit4] 2> 21740 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[56 (1428904157089103872)]} 0 0
[junit4:junit4] 2> 21741 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[56 (1428904157089103872)]} 0 3
[junit4:junit4] 2> 21741 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[56]} 0 5
[junit4:junit4] 2> 21748 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[57 (1428904157096443904)]} 0 1
[junit4:junit4] 2> 21748 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[57 (1428904157096443904)]} 0 1
[junit4:junit4] 2> 21748 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[57 (1428904157096443904)]} 0 3
[junit4:junit4] 2> 21749 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[57]} 0 6
[junit4:junit4] 2> 21755 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[58 (1428904157104832512)]} 0 0
[junit4:junit4] 2> 21756 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[58 (1428904157104832512)]} 0 1
[junit4:junit4] 2> 21756 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[58 (1428904157104832512)]} 0 3
[junit4:junit4] 2> 21757 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[58]} 0 6
[junit4:junit4] 2> 21763 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[59 (1428904157113221120)]} 0 0
[junit4:junit4] 2> 21763 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[59 (1428904157113221120)]} 0 0
[junit4:junit4] 2> 21764 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[59 (1428904157113221120)]} 0 4
[junit4:junit4] 2> 21765 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[59]} 0 6
[junit4:junit4] 2> 21771 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[60 (1428904157120561152)]} 0 0
[junit4:junit4] 2> 21771 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[60 (1428904157120561152)]} 0 0
[junit4:junit4] 2> 21772 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[60 (1428904157120561152)]} 0 4
[junit4:junit4] 2> 21772 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[60]} 0 5
[junit4:junit4] 2> 21778 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[61 (1428904157128949760)]} 0 0
[junit4:junit4] 2> 21778 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[61 (1428904157128949760)]} 0 0
[junit4:junit4] 2> 21779 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[61 (1428904157128949760)]} 0 3
[junit4:junit4] 2> 21780 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[61]} 0 6
[junit4:junit4] 2> 21786 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[62 (1428904157137338368)]} 0 0
[junit4:junit4] 2> 21786 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[62 (1428904157137338368)]} 0 0
[junit4:junit4] 2> 21787 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[62 (1428904157137338368)]} 0 3
[junit4:junit4] 2> 21787 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[62]} 0 5
[junit4:junit4] 2> 21794 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[63 (1428904157144678400)]} 0 1
[junit4:junit4] 2> 21794 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[63 (1428904157144678400)]} 0 0
[junit4:junit4] 2> 21794 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[63 (1428904157144678400)]} 0 3
[junit4:junit4] 2> 21795 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[63]} 0 6
[junit4:junit4] 2> 21801 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[64 (1428904157153067008)]} 0 0
[junit4:junit4] 2> 21801 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[64 (1428904157153067008)]} 0 0
[junit4:junit4] 2> 21802 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[64 (1428904157153067008)]} 0 3
[junit4:junit4] 2> 21802 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[64]} 0 5
[junit4:junit4] 2> 21809 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[65 (1428904157161455616)]} 0 0
[junit4:junit4] 2> 21809 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[65 (1428904157161455616)]} 0 0
[junit4:junit4] 2> 21810 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[65 (1428904157161455616)]} 0 4
[junit4:junit4] 2> 21810 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[65]} 0 5
[junit4:junit4] 2> 21817 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[66 (1428904157168795648)]} 0 1
[junit4:junit4] 2> 21817 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[66 (1428904157168795648)]} 0 1
[junit4:junit4] 2> 21817 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[66 (1428904157168795648)]} 0 3
[junit4:junit4] 2> 21818 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[66]} 0 6
[junit4:junit4] 2> 21824 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[67 (1428904157177184256)]} 0 0
[junit4:junit4] 2> 21825 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[67 (1428904157177184256)]} 0 1
[junit4:junit4] 2> 21825 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[67 (1428904157177184256)]} 0 3
[junit4:junit4] 2> 21826 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[67]} 0 6
[junit4:junit4] 2> 21832 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[68 (1428904157185572864)]} 0 0
[junit4:junit4] 2> 21832 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[68 (1428904157185572864)]} 0 0
[junit4:junit4] 2> 21833 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[68 (1428904157185572864)]} 0 3
[junit4:junit4] 2> 21833 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[68]} 0 5
[junit4:junit4] 2> 21840 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[69 (1428904157192912896)]} 0 1
[junit4:junit4] 2> 21840 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[69 (1428904157192912896)]} 0 1
[junit4:junit4] 2> 21841 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[69 (1428904157192912896)]} 0 4
[junit4:junit4] 2> 21841 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[69]} 0 5
[junit4:junit4] 2> 21848 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[70 (1428904157201301504)]} 0 1
[junit4:junit4] 2> 21848 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[70 (1428904157201301504)]} 0 1
[junit4:junit4] 2> 21849 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[70 (1428904157201301504)]} 0 4
[junit4:junit4] 2> 21849 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[70]} 0 6
[junit4:junit4] 2> 21856 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[71 (1428904157209690112)]} 0 1
[junit4:junit4] 2> 21856 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[71 (1428904157209690112)]} 0 1
[junit4:junit4] 2> 21856 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[71 (1428904157209690112)]} 0 3
[junit4:junit4] 2> 21857 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[71]} 0 6
[junit4:junit4] 2> 21864 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[72 (1428904157218078720)]} 0 1
[junit4:junit4] 2> 21864 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[72 (1428904157218078720)]} 0 1
[junit4:junit4] 2> 21864 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[72 (1428904157218078720)]} 0 3
[junit4:junit4] 2> 21865 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[72]} 0 6
[junit4:junit4] 2> 21883 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[73 (1428904157238001664)]} 0 1
[junit4:junit4] 2> 21883 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[73 (1428904157238001664)]} 0 1
[junit4:junit4] 2> 21884 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[73 (1428904157238001664)]} 0 15
[junit4:junit4] 2> 21884 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[73]} 0 17
[junit4:junit4] 2> 21891 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[74 (1428904157246390272)]} 0 0
[junit4:junit4] 2> 21891 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[74 (1428904157246390272)]} 0 0
[junit4:junit4] 2> 21892 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[74 (1428904157246390272)]} 0 4
[junit4:junit4] 2> 21892 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[74]} 0 6
[junit4:junit4] 2> 21899 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[75 (1428904157254778880)]} 0 1
[junit4:junit4] 2> 21899 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[75 (1428904157254778880)]} 0 1
[junit4:junit4] 2> 21899 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[75 (1428904157254778880)]} 0 3
[junit4:junit4] 2> 21900 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[75]} 0 6
[junit4:junit4] 2> 21906 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[76 (1428904157263167488)]} 0 0
[junit4:junit4] 2> 21906 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[76 (1428904157263167488)]} 0 0
[junit4:junit4] 2> 21907 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[76 (1428904157263167488)]} 0 3
[junit4:junit4] 2> 21907 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[76]} 0 5
[junit4:junit4] 2> 21914 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[77 (1428904157270507520)]} 0 0
[junit4:junit4] 2> 21914 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[77 (1428904157270507520)]} 0 0
[junit4:junit4] 2> 21915 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[77 (1428904157270507520)]} 0 4
[junit4:junit4] 2> 21915 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[77]} 0 5
[junit4:junit4] 2> 21922 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[78 (1428904157278896128)]} 0 1
[junit4:junit4] 2> 21922 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[78 (1428904157278896128)]} 0 1
[junit4:junit4] 2> 21922 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[78 (1428904157278896128)]} 0 3
[junit4:junit4] 2> 21923 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[78]} 0 6
[junit4:junit4] 2> 21929 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[79 (1428904157287284736)]} 0 0
[junit4:junit4] 2> 21929 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[79 (1428904157287284736)]} 0 0
[junit4:junit4] 2> 21930 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[79 (1428904157287284736)]} 0 3
[junit4:junit4] 2> 21931 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[79]} 0 6
[junit4:junit4] 2> 21937 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[80 (1428904157294624768)]} 0 1
[junit4:junit4] 2> 21937 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[80 (1428904157294624768)]} 0 1
[junit4:junit4] 2> 21938 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[80 (1428904157294624768)]} 0 4
[junit4:junit4] 2> 21938 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[80]} 0 6
[junit4:junit4] 2> 21944 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[81 (1428904157303013376)]} 0 0
[junit4:junit4] 2> 21945 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[81 (1428904157303013376)]} 0 1
[junit4:junit4] 2> 21945 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[81 (1428904157303013376)]} 0 3
[junit4:junit4] 2> 21946 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[81]} 0 6
[junit4:junit4] 2> 21952 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[82 (1428904157311401984)]} 0 0
[junit4:junit4] 2> 21952 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[82 (1428904157311401984)]} 0 0
[junit4:junit4] 2> 21953 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[82 (1428904157311401984)]} 0 3
[junit4:junit4] 2> 21953 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[82]} 0 5
[junit4:junit4] 2> 21960 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[83 (1428904157318742016)]} 0 1
[junit4:junit4] 2> 21960 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[83 (1428904157318742016)]} 0 1
[junit4:junit4] 2> 21960 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[83 (1428904157318742016)]} 0 3
[junit4:junit4] 2> 21961 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[83]} 0 6
[junit4:junit4] 2> 21967 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[84 (1428904157327130624)]} 0 0
[junit4:junit4] 2> 21967 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[84 (1428904157327130624)]} 0 0
[junit4:junit4] 2> 21968 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[84 (1428904157327130624)]} 0 3
[junit4:junit4] 2> 21969 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[84]} 0 6
[junit4:junit4] 2> 21975 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[85 (1428904157335519232)]} 0 0
[junit4:junit4] 2> 21975 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[85 (1428904157335519232)]} 0 0
[junit4:junit4] 2> 21976 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[85 (1428904157335519232)]} 0 4
[junit4:junit4] 2> 21976 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[85]} 0 5
[junit4:junit4] 2> 21983 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[86 (1428904157342859264)]} 0 1
[junit4:junit4] 2> 21983 T2207 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[86 (1428904157342859264)]} 0 1
[junit4:junit4] 2> 21983 T2180 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[86 (1428904157342859264)]} 0 3
[junit4:junit4] 2> 21984 T2206 C84 P35978 /update {version=2&wt=javabin} {add=[86]} 0 6
[junit4:junit4] 2> 21990 T2204 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[87 (1428904157351247872)]} 0 0
[junit4:junit4] 2> 21990 T2191 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[87 (1428904157351247872)]} 0 0
[junit4:junit4] 2> 21991 T2181 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[87 (1428904157351247872)]} 0 3
[junit4:junit4] 2> 21992 T2205 C84 P35978 /update {version=2&wt=javabin} {add=[87]} 0 6
[junit4:junit4] 2> 21998 T2206 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[88 (1428904157359636480)]} 0 1
[junit4:junit4] 2> 21998 T2192 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[88 (1428904157359636480)]} 0 1
[junit4:junit4] 2> 21998 T2178 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[88 (1428904157359636480)]} 0 3
[junit4:junit4] 2> 21999 T2207 C84 P35978 /update {version=2&wt=javabin} {add=[88]} 0 5
[junit4:junit4] 2> 22005 T2205 C84 P35978 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[89 (1428904157366976512)]} 0 0
[junit4:junit4] 2> 22005 T2194 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[89 (1428904157366976512)]} 0 0
[junit4:junit4] 2> 22006 T2179 C83 P33473 /update {distrib.from=http://127.0.0.1:35978/kmax/u/unloadcollection3/&update.distrib=TOLEADER&version=2&wt=javabin} {add=[89 (1428904157366976512)]} 0 3
[junit4:junit4] 2> 22007 T2204 C84 P35978 /update {version=2&wt=javabin} {add=[89]} 0 6
[junit4:junit4] 2> 22013 T2193 C82 P39443 /update {distrib.from=http://127.0.0.1:33473/kmax/u/unloadcollection1/&update.distrib=FROMLEADER&version=2&wt=javabin} {add=[
[...truncated too long message...]
_0000000002 (0)
[junit4:junit4] 1> /solr/collections/collection1 (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=78264521D32C9F79 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=Etc/GMT-13 -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 140s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([78264521D32C9F79:F9C0CB39A473FF45]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 139674 T2146 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 139683 T2145 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 140516 T2149 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=pt_BR, timezone=Etc/GMT-13
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=71904344,total=179363840
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestComponentsName, TermVectorComponentDistributedTest, CoreContainerCoreInitFailuresTest, ZkNodePropsTest, TestJmxMonitoredMap, SuggesterWFSTTest, TestSort, DocumentBuilderTest, TestCollationKeyRangeQueries, HighlighterConfigTest, TestValueSourceCache, TestStressReorder, TestPartialUpdateDeduplication, UpdateRequestProcessorFactoryTest, SampleTest, TestSuggestSpellingConverter, TimeZoneUtilsTest, QueryParsingTest, ClusterStateUpdateTest, BadIndexSchemaTest, TermVectorComponentTest, XsltUpdateRequestHandlerTest, SimpleFacetsTest, RegexBoostProcessorTest, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestRandomDVFaceting, OutputWriterTest, TestSystemIdResolver, TestZkChroot, TestUtils, SimplePostToolTest, SuggesterFSTTest, URLClassifyProcessorTest, DateMathParserTest, AliasIntegrationTest, TestQuerySenderNoQuery, PrimitiveFieldTypeTest, TestFaceting, TestCodecSupport, IndexSchemaTest, CurrencyFieldXmlFileTest, FastVectorHighlighterTest, TestLuceneMatchVersion, NotRequiredUniqueKeyTest, TestPropInject, DistributedQueryElevationComponentTest, HighlighterTest, UniqFieldsUpdateProcessorFactoryTest, OverseerCollectionProcessorTest, IndexReaderFactoryTest, TestDefaultSimilarityFactory, SpellCheckComponentTest, TestBinaryResponseWriter, TermsComponentTest, TestCopyFieldCollectionResource, DistanceFunctionTest, DebugComponentTest, SoftAutoCommitTest, FullSolrCloudDistribCmdsTest, OverseerTest, DocValuesTest, TestFastOutputStream, EchoParamsTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 140.70s, 1 test, 1 failure <<< FAILURES!
[...truncated 453 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 268 suites, 1130 tests, 1 failure, 9 ignored (3 assumptions)
Total time: 41 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure