You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/10 04:48:51 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4645 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4645/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:36516/xl/r/onenodecollectioncore returned non ok status:404, message:Can not find: /xl/r/onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:36516/xl/r/onenodecollectioncore returned non ok status:404, message:Can not find: /xl/r/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([F25AC9C02AD88397:73BC47D85D87E3AB]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:200)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9180 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T1806 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xl/r
[junit4:junit4] 2> 7 T1806 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770
[junit4:junit4] 2> 8 T1806 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 9 T1807 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T1807 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T1807 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T1807 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1807 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T1807 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 109 T1806 oasc.ZkTestServer.run start zk server on port:46079
[junit4:junit4] 2> 110 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@25380992
[junit4:junit4] 2> 110 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 111 T1812 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 111 T1812 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 111 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55031
[junit4:junit4] 2> 111 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55031
[junit4:junit4] 2> 112 T1810 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 113 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0000 with negotiated timeout 10000 for client /127.0.0.1:55031
[junit4:junit4] 2> 113 T1812 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0000, negotiated timeout = 10000
[junit4:junit4] 2> 113 T1813 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25380992 name:ZooKeeperConnection Watcher:127.0.0.1:46079 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 114 T1806 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 116 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0000
[junit4:junit4] 2> 116 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0000 closed
[junit4:junit4] 2> 117 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55031 which had sessionid 0x13d5263142d0000
[junit4:junit4] 2> 116 T1813 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 117 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2bfff345
[junit4:junit4] 2> 118 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 118 T1814 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 119 T1814 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 119 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55032
[junit4:junit4] 2> 120 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55032
[junit4:junit4] 2> 121 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0001 with negotiated timeout 10000 for client /127.0.0.1:55032
[junit4:junit4] 2> 121 T1814 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0001, negotiated timeout = 10000
[junit4:junit4] 2> 121 T1815 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bfff345 name:ZooKeeperConnection Watcher:127.0.0.1:46079/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 122 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 122 T1806 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 126 T1806 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 130 T1806 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 132 T1806 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 136 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 137 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 142 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 143 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 148 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 149 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 152 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 153 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 157 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 158 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 162 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 162 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 166 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 167 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 171 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 172 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 175 T1806 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 176 T1806 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 179 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0001
[junit4:junit4] 2> 180 T1815 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 180 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55032 which had sessionid 0x13d5263142d0001
[junit4:junit4] 2> 180 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0001 closed
[junit4:junit4] 2> 259 T1806 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 286 T1806 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49610
[junit4:junit4] 2> 287 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 287 T1806 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 287 T1806 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943
[junit4:junit4] 2> 288 T1806 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/solr.xml
[junit4:junit4] 2> 288 T1806 oasc.CoreContainer.<init> New CoreContainer 1813854017
[junit4:junit4] 2> 288 T1806 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/'
[junit4:junit4] 2> 289 T1806 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/'
[junit4:junit4] 2> 330 T1806 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 331 T1806 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 331 T1806 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 331 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 332 T1806 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 332 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 332 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 333 T1806 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 333 T1806 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 333 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 338 T1806 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 347 T1806 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46079/solr
[junit4:junit4] 2> 347 T1806 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 348 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@126d7a97
[junit4:junit4] 2> 348 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 349 T1825 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 349 T1825 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 349 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55034
[junit4:junit4] 2> 349 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55034
[junit4:junit4] 2> 350 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0002 with negotiated timeout 20000 for client /127.0.0.1:55034
[junit4:junit4] 2> 350 T1825 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0002, negotiated timeout = 20000
[junit4:junit4] 2> 350 T1826 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@126d7a97 name:ZooKeeperConnection Watcher:127.0.0.1:46079 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 351 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 351 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0002
[junit4:junit4] 2> 352 T1826 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 352 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55034 which had sessionid 0x13d5263142d0002
[junit4:junit4] 2> 352 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0002 closed
[junit4:junit4] 2> 352 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 355 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7e378ca
[junit4:junit4] 2> 355 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 355 T1827 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 356 T1827 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 356 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55035
[junit4:junit4] 2> 356 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55035
[junit4:junit4] 2> 357 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0003 with negotiated timeout 20000 for client /127.0.0.1:55035
[junit4:junit4] 2> 357 T1827 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0003, negotiated timeout = 20000
[junit4:junit4] 2> 357 T1828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e378ca name:ZooKeeperConnection Watcher:127.0.0.1:46079/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 357 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 358 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 359 T1806 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 360 T1806 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49610_xl%2Fr
[junit4:junit4] 2> 360 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49610_xl%2Fr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49610_xl%2Fr
[junit4:junit4] 2> 361 T1806 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49610_xl%2Fr
[junit4:junit4] 2> 363 T1806 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 365 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 366 T1806 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 368 T1806 oasc.Overseer.start Overseer (id=89318153111011331-127.0.0.1:49610_xl%2Fr-n_0000000000) starting
[junit4:junit4] 2> 368 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 370 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 371 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 372 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 373 T1830 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 373 T1806 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 376 T1806 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 378 T1806 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 381 T1829 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 384 T1831 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/collection1
[junit4:junit4] 2> 385 T1831 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 385 T1831 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 386 T1831 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 387 T1831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/collection1/'
[junit4:junit4] 2> 388 T1831 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/collection1/lib/README' to classloader
[junit4:junit4] 2> 388 T1831 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 420 T1831 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 462 T1831 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 463 T1831 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 466 T1831 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 790 T1831 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 796 T1831 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 798 T1831 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 808 T1831 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 811 T1831 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 814 T1831 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 815 T1831 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 815 T1831 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 815 T1831 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 816 T1831 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 817 T1831 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 817 T1831 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362886857943/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/
[junit4:junit4] 2> 817 T1831 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66bddd65
[junit4:junit4] 2> 817 T1831 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 818 T1831 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data forceNew: false
[junit4:junit4] 2> 818 T1831 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/index/
[junit4:junit4] 2> 818 T1831 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 819 T1831 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/index forceNew: false
[junit4:junit4] 2> 821 T1831 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dd96511 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2cdf15e1),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 821 T1831 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 822 T1831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 823 T1831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 823 T1831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 824 T1831 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 824 T1831 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 824 T1831 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 824 T1831 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 825 T1831 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 825 T1831 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 828 T1831 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 830 T1831 oass.SolrIndexSearcher.<init> Opening Searcher@6eca01c7 main
[junit4:junit4] 2> 831 T1831 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/tlog
[junit4:junit4] 2> 831 T1831 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 832 T1831 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 834 T1832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6eca01c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 836 T1831 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 836 T1831 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 837 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1886 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1887 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:49610_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49610/xl/r"}
[junit4:junit4] 2> 1887 T1829 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1888 T1829 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1888 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1896 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2839 T1831 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2839 T1831 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49610/xl/r collection:control_collection shard:shard1
[junit4:junit4] 2> 2840 T1831 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2845 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2845 T1831 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2846 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2847 T1831 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2847 T1831 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2847 T1831 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49610/xl/r/collection1/
[junit4:junit4] 2> 2847 T1831 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2848 T1831 oasc.SyncStrategy.syncToMe http://127.0.0.1:49610/xl/r/collection1/ has no replicas
[junit4:junit4] 2> 2848 T1831 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49610/xl/r/collection1/
[junit4:junit4] 2> 2848 T1831 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2851 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3402 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3674 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3704 T1831 oasc.ZkController.register We are http://127.0.0.1:49610/xl/r/collection1/ and leader is http://127.0.0.1:49610/xl/r/collection1/
[junit4:junit4] 2> 3704 T1831 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49610/xl/r
[junit4:junit4] 2> 3704 T1831 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3704 T1831 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3705 T1831 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3706 T1831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3707 T1806 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3707 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3707 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3710 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3710 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5de79359
[junit4:junit4] 2> 3711 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3711 T1835 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3712 T1835 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 3712 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55039
[junit4:junit4] 2> 3712 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55039
[junit4:junit4] 2> 3713 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0004 with negotiated timeout 10000 for client /127.0.0.1:55039
[junit4:junit4] 2> 3713 T1835 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0004, negotiated timeout = 10000
[junit4:junit4] 2> 3713 T1836 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5de79359 name:ZooKeeperConnection Watcher:127.0.0.1:46079/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3713 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3714 T1806 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3715 T1806 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3769 T1806 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3771 T1806 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47879
[junit4:junit4] 2> 3772 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3773 T1806 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3773 T1806 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478
[junit4:junit4] 2> 3773 T1806 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/solr.xml
[junit4:junit4] 2> 3773 T1806 oasc.CoreContainer.<init> New CoreContainer 1017801452
[junit4:junit4] 2> 3774 T1806 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/'
[junit4:junit4] 2> 3774 T1806 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/'
[junit4:junit4] 2> 3790 T1806 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3790 T1806 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3791 T1806 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3791 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3791 T1806 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3791 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3792 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3792 T1806 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3792 T1806 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3792 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3798 T1806 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3806 T1806 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46079/solr
[junit4:junit4] 2> 3806 T1806 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3807 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@790ac477
[junit4:junit4] 2> 3807 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3808 T1846 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3808 T1846 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 3808 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55040
[junit4:junit4] 2> 3808 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55040
[junit4:junit4] 2> 3809 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0005 with negotiated timeout 20000 for client /127.0.0.1:55040
[junit4:junit4] 2> 3809 T1846 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0005, negotiated timeout = 20000
[junit4:junit4] 2> 3809 T1847 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@790ac477 name:ZooKeeperConnection Watcher:127.0.0.1:46079 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3810 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3821 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0005
[junit4:junit4] 2> 3822 T1847 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3822 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55040 which had sessionid 0x13d5263142d0005
[junit4:junit4] 2> 3822 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0005 closed
[junit4:junit4] 2> 3823 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3825 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1856ee9b
[junit4:junit4] 2> 3826 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3826 T1848 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3827 T1848 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 3827 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55041
[junit4:junit4] 2> 3827 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55041
[junit4:junit4] 2> 3828 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0006 with negotiated timeout 20000 for client /127.0.0.1:55041
[junit4:junit4] 2> 3828 T1848 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0006, negotiated timeout = 20000
[junit4:junit4] 2> 3828 T1849 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1856ee9b name:ZooKeeperConnection Watcher:127.0.0.1:46079/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3828 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3829 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3830 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3831 T1806 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4833 T1806 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47879_xl%2Fr
[junit4:junit4] 2> 4834 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47879_xl%2Fr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47879_xl%2Fr
[junit4:junit4] 2> 4835 T1806 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47879_xl%2Fr
[junit4:junit4] 2> 4838 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4838 T1836 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4838 T1849 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4839 T1828 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4843 T1850 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/collection1
[junit4:junit4] 2> 4843 T1850 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4843 T1850 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4843 T1850 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4844 T1850 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/collection1/'
[junit4:junit4] 2> 4844 T1850 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/collection1/lib/README' to classloader
[junit4:junit4] 2> 4845 T1850 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4865 T1850 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4890 T1850 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4891 T1850 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4894 T1850 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5179 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5179 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:49610_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49610/xl/r"}
[junit4:junit4] 2> 5182 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5182 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5182 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5202 T1850 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5206 T1850 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5208 T1850 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5218 T1850 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5221 T1850 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5224 T1850 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5225 T1850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5225 T1850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5225 T1850 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5226 T1850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5227 T1850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5227 T1850 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/
[junit4:junit4] 2> 5227 T1850 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66bddd65
[junit4:junit4] 2> 5227 T1850 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5228 T1850 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1 forceNew: false
[junit4:junit4] 2> 5228 T1850 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/index/
[junit4:junit4] 2> 5228 T1850 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5228 T1850 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/index forceNew: false
[junit4:junit4] 2> 5230 T1850 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55d89d83 lockFactory=org.apache.lucene.store.NativeFSLockFactory@733bba0f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5230 T1850 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5231 T1850 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5231 T1850 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5232 T1850 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5232 T1850 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5233 T1850 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5233 T1850 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5233 T1850 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5233 T1850 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5233 T1850 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5236 T1850 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5238 T1850 oass.SolrIndexSearcher.<init> Opening Searcher@cee06f8 main
[junit4:junit4] 2> 5238 T1850 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/tlog
[junit4:junit4] 2> 5238 T1850 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5239 T1850 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5241 T1851 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cee06f8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5242 T1850 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5242 T1850 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6686 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6686 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 6686 T1829 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6686 T1829 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 6692 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6692 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6692 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7244 T1850 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7244 T1850 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47879/xl/r collection:collection1 shard:shard2
[junit4:junit4] 2> 7245 T1850 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 7250 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7250 T1850 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7250 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7251 T1850 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7252 T1850 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7252 T1850 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47879/xl/r/collection1/
[junit4:junit4] 2> 7252 T1850 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7252 T1850 oasc.SyncStrategy.syncToMe http://127.0.0.1:47879/xl/r/collection1/ has no replicas
[junit4:junit4] 2> 7252 T1850 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47879/xl/r/collection1/
[junit4:junit4] 2> 7252 T1850 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 7255 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8196 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8203 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8203 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8203 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8209 T1850 oasc.ZkController.register We are http://127.0.0.1:47879/xl/r/collection1/ and leader is http://127.0.0.1:47879/xl/r/collection1/
[junit4:junit4] 2> 8209 T1850 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47879/xl/r
[junit4:junit4] 2> 8209 T1850 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8209 T1850 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8209 T1850 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8210 T1850 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8211 T1806 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8212 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8212 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8276 T1806 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8285 T1806 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36516
[junit4:junit4] 2> 8285 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8286 T1806 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8286 T1806 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977
[junit4:junit4] 2> 8286 T1806 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/solr.xml
[junit4:junit4] 2> 8287 T1806 oasc.CoreContainer.<init> New CoreContainer 11987235
[junit4:junit4] 2> 8287 T1806 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/'
[junit4:junit4] 2> 8287 T1806 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/'
[junit4:junit4] 2> 8303 T1806 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8303 T1806 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8304 T1806 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8304 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8304 T1806 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8304 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8305 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8305 T1806 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8305 T1806 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8305 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8311 T1806 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8319 T1806 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46079/solr
[junit4:junit4] 2> 8319 T1806 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8320 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2f9d554a
[junit4:junit4] 2> 8321 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8321 T1862 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8321 T1862 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 8322 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55056
[junit4:junit4] 2> 8322 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55056
[junit4:junit4] 2> 8323 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0007 with negotiated timeout 20000 for client /127.0.0.1:55056
[junit4:junit4] 2> 8323 T1862 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0007, negotiated timeout = 20000
[junit4:junit4] 2> 8323 T1863 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f9d554a name:ZooKeeperConnection Watcher:127.0.0.1:46079 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8323 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8324 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0007
[junit4:junit4] 2> 8324 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55056 which had sessionid 0x13d5263142d0007
[junit4:junit4] 2> 8324 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0007 closed
[junit4:junit4] 2> 8325 T1863 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8325 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8327 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f4ac5f3
[junit4:junit4] 2> 8328 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8328 T1864 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8329 T1864 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 8329 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55057
[junit4:junit4] 2> 8329 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55057
[junit4:junit4] 2> 8330 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0008 with negotiated timeout 20000 for client /127.0.0.1:55057
[junit4:junit4] 2> 8330 T1864 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0008, negotiated timeout = 20000
[junit4:junit4] 2> 8330 T1865 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f4ac5f3 name:ZooKeeperConnection Watcher:127.0.0.1:46079/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8331 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8331 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8332 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8333 T1806 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9336 T1806 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36516_xl%2Fr
[junit4:junit4] 2> 9337 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36516_xl%2Fr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36516_xl%2Fr
[junit4:junit4] 2> 9337 T1806 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36516_xl%2Fr
[junit4:junit4] 2> 9340 T1849 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9340 T1836 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9341 T1865 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9341 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9341 T1828 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9341 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9341 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9345 T1866 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/collection1
[junit4:junit4] 2> 9345 T1866 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9345 T1866 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9346 T1866 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9347 T1866 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/collection1/'
[junit4:junit4] 2> 9347 T1866 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/collection1/lib/README' to classloader
[junit4:junit4] 2> 9347 T1866 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9377 T1866 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9402 T1866 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9403 T1866 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9406 T1866 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9701 T1866 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9706 T1866 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9708 T1866 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9708 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9709 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 9712 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9712 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9713 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9713 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9719 T1866 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9721 T1866 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9724 T1866 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9725 T1866 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9725 T1866 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9725 T1866 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9726 T1866 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9726 T1866 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9727 T1866 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362886865977/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/
[junit4:junit4] 2> 9727 T1866 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66bddd65
[junit4:junit4] 2> 9727 T1866 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9728 T1866 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2 forceNew: false
[junit4:junit4] 2> 9728 T1866 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/index/
[junit4:junit4] 2> 9728 T1866 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9728 T1866 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/index forceNew: false
[junit4:junit4] 2> 9729 T1866 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a61f448 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2551049d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9730 T1866 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9731 T1866 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9731 T1866 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9732 T1866 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9732 T1866 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9732 T1866 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9732 T1866 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9733 T1866 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9733 T1866 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9733 T1866 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9736 T1866 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9738 T1866 oass.SolrIndexSearcher.<init> Opening Searcher@ff36969 main
[junit4:junit4] 2> 9738 T1866 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/tlog
[junit4:junit4] 2> 9738 T1866 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9738 T1866 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9743 T1867 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ff36969 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9754 T1866 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9754 T1866 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11217 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11217 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36516_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36516/xl/r"}
[junit4:junit4] 2> 11218 T1829 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11218 T1829 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11221 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11221 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11221 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11221 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11757 T1866 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11757 T1866 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36516/xl/r collection:collection1 shard:shard1
[junit4:junit4] 2> 11758 T1866 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 11763 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 11763 T1866 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11764 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11765 T1866 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11765 T1866 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11766 T1866 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36516/xl/r/collection1/
[junit4:junit4] 2> 11766 T1866 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11766 T1866 oasc.SyncStrategy.syncToMe http://127.0.0.1:36516/xl/r/collection1/ has no replicas
[junit4:junit4] 2> 11766 T1866 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36516/xl/r/collection1/
[junit4:junit4] 2> 11766 T1866 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 11769 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12725 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12739 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12739 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12739 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12739 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12774 T1866 oasc.ZkController.register We are http://127.0.0.1:36516/xl/r/collection1/ and leader is http://127.0.0.1:36516/xl/r/collection1/
[junit4:junit4] 2> 12774 T1866 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36516/xl/r
[junit4:junit4] 2> 12774 T1866 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12774 T1866 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12774 T1866 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12776 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12777 T1806 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12777 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12778 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12835 T1806 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12841 T1806 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50250
[junit4:junit4] 2> 12842 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12842 T1806 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12843 T1806 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542
[junit4:junit4] 2> 12843 T1806 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/solr.xml
[junit4:junit4] 2> 12843 T1806 oasc.CoreContainer.<init> New CoreContainer 1469151341
[junit4:junit4] 2> 12844 T1806 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/'
[junit4:junit4] 2> 12844 T1806 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/'
[junit4:junit4] 2> 12861 T1806 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12862 T1806 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12862 T1806 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12862 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12862 T1806 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12863 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12863 T1806 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12863 T1806 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12864 T1806 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12864 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12869 T1806 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12878 T1806 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46079/solr
[junit4:junit4] 2> 12879 T1806 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12879 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4ddac851
[junit4:junit4] 2> 12880 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12880 T1878 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12881 T1878 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 12881 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55062
[junit4:junit4] 2> 12881 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55062
[junit4:junit4] 2> 12882 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d0009 with negotiated timeout 20000 for client /127.0.0.1:55062
[junit4:junit4] 2> 12882 T1878 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d0009, negotiated timeout = 20000
[junit4:junit4] 2> 12882 T1879 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ddac851 name:ZooKeeperConnection Watcher:127.0.0.1:46079 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12882 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12883 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0009
[junit4:junit4] 2> 12884 T1879 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12884 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0009 closed
[junit4:junit4] 2> 12884 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55062 which had sessionid 0x13d5263142d0009
[junit4:junit4] 2> 12884 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12887 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@455f85aa
[junit4:junit4] 2> 12887 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12887 T1880 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12888 T1880 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 12888 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55063
[junit4:junit4] 2> 12888 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55063
[junit4:junit4] 2> 12889 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d000a with negotiated timeout 20000 for client /127.0.0.1:55063
[junit4:junit4] 2> 12889 T1880 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d000a, negotiated timeout = 20000
[junit4:junit4] 2> 12889 T1881 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@455f85aa name:ZooKeeperConnection Watcher:127.0.0.1:46079/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12889 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12890 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12891 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12892 T1806 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13894 T1806 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50250_xl%2Fr
[junit4:junit4] 2> 13895 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50250_xl%2Fr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50250_xl%2Fr
[junit4:junit4] 2> 13896 T1806 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50250_xl%2Fr
[junit4:junit4] 2> 13898 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13899 T1836 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13899 T1865 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13899 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13899 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13899 T1828 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13899 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13899 T1881 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13900 T1849 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13904 T1882 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/collection1
[junit4:junit4] 2> 13904 T1882 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13905 T1882 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13905 T1882 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13906 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/collection1/'
[junit4:junit4] 2> 13906 T1882 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/collection1/lib/README' to classloader
[junit4:junit4] 2> 13907 T1882 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13928 T1882 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 13964 T1882 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13965 T1882 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13968 T1882 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14245 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14246 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36516_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36516/xl/r"}
[junit4:junit4] 2> 14249 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14249 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14249 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14249 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14250 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14272 T1882 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14276 T1882 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14278 T1882 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14287 T1882 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14290 T1882 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14292 T1882 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14293 T1882 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14293 T1882 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14294 T1882 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14294 T1882 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14295 T1882 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14295 T1882 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362886870542/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/
[junit4:junit4] 2> 14295 T1882 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66bddd65
[junit4:junit4] 2> 14295 T1882 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14296 T1882 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3 forceNew: false
[junit4:junit4] 2> 14296 T1882 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index/
[junit4:junit4] 2> 14296 T1882 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14296 T1882 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index forceNew: false
[junit4:junit4] 2> 14297 T1882 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cda35ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@6887d56d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14298 T1882 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14299 T1882 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14299 T1882 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14300 T1882 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14300 T1882 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14300 T1882 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14301 T1882 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14301 T1882 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14301 T1882 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14301 T1882 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14303 T1882 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14305 T1882 oass.SolrIndexSearcher.<init> Opening Searcher@619d9cf6 main
[junit4:junit4] 2> 14306 T1882 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/tlog
[junit4:junit4] 2> 14306 T1882 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14306 T1882 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14309 T1883 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@619d9cf6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14310 T1882 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14310 T1882 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15754 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15755 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50250_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50250/xl/r"}
[junit4:junit4] 2> 15755 T1829 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15755 T1829 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 15759 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15759 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15759 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15759 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15759 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16312 T1882 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16312 T1882 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50250/xl/r collection:collection1 shard:shard2
[junit4:junit4] 2> 16315 T1882 oasc.ZkController.register We are http://127.0.0.1:50250/xl/r/collection1/ and leader is http://127.0.0.1:47879/xl/r/collection1/
[junit4:junit4] 2> 16316 T1882 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50250/xl/r
[junit4:junit4] 2> 16316 T1882 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16316 T1882 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C133 name=collection1 org.apache.solr.core.SolrCore@7ee2adc0 url=http://127.0.0.1:50250/xl/r/collection1 node=127.0.0.1:50250_xl%2Fr C133_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, collection=collection1, node_name=127.0.0.1:50250_xl%2Fr, base_url=http://127.0.0.1:50250/xl/r}
[junit4:junit4] 2> 16316 T1884 C133 P50250 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16317 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16317 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16317 T1884 C133 P50250 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16317 T1884 C133 P50250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16318 T1806 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16318 T1884 C133 P50250 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16318 T1806 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16319 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16323 T1806 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16324 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16327 T1844 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/onenodecollectioncore
[junit4:junit4] 2> 16327 T1844 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 16328 T1844 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 16328 T1844 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 16329 T1844 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 16329 T1844 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 16331 T1844 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 16332 T1844 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/onenodecollectioncore/'
[junit4:junit4] 2> 16367 T1844 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 16392 T1844 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16394 T1844 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16397 T1844 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16699 T1844 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16704 T1844 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16706 T1844 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16717 T1844 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16720 T1844 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16722 T1844 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16723 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16724 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16724 T1844 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16725 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16726 T1844 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16726 T1844 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362886861478/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/
[junit4:junit4] 2> 16726 T1844 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66bddd65
[junit4:junit4] 2> 16726 T1844 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16727 T1844 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection forceNew: false
[junit4:junit4] 2> 16727 T1844 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/index/
[junit4:junit4] 2> 16728 T1844 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16728 T1844 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/index forceNew: false
[junit4:junit4] 2> 16729 T1844 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f1b8cb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e07d683),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16730 T1844 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16731 T1844 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16731 T1844 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16732 T1844 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16732 T1844 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16733 T1844 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16733 T1844 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16733 T1844 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16733 T1844 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16734 T1844 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16736 T1844 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16747 T1844 oass.SolrIndexSearcher.<init> Opening Searcher@ce6522f main
[junit4:junit4] 2> 16748 T1844 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/tlog
[junit4:junit4] 2> 16748 T1844 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16749 T1844 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16752 T1886 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@ce6522f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16752 T1844 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 17262 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17263 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50250_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50250/xl/r"}
[junit4:junit4] 2> 17265 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 17266 T1829 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 17266 T1829 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17269 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17269 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17269 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17269 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17270 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17323 T1845 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {core=collection1&action=PREPRECOVERY&nodeName=127.0.0.1:50250_xl%252Fr&version=2&checkLive=true&wt=javabin&state=recovering&coreNodeName=4&onlyIfLeader=true} status=0 QTime=1000
[junit4:junit4] 2> 17754 T1844 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 17754 T1844 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:47879/xl/r collection:onenodecollection shard:shard1
[junit4:junit4] 2> 17755 T1844 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 17760 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:delete cxid:0xa1 zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 17761 T1844 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 17761 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0xa2 zxid:0xae txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17762 T1844 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 17763 T1844 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 17763 T1844 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47879/xl/r/onenodecollectioncore/
[junit4:junit4] 2> 17763 T1844 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 17763 T1844 oasc.SyncStrategy.syncToMe http://127.0.0.1:47879/xl/r/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 17763 T1844 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47879/xl/r/onenodecollectioncore/
[junit4:junit4] 2> 17764 T1844 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 17767 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0xac zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18775 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18782 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18782 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18782 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18782 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18782 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18821 T1844 oasc.ZkController.register We are http://127.0.0.1:47879/xl/r/onenodecollectioncore/ and leader is http://127.0.0.1:47879/xl/r/onenodecollectioncore/
[junit4:junit4] 2> 18821 T1844 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:47879/xl/r
[junit4:junit4] 2> 18822 T1844 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 18822 T1844 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 18824 T1844 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18824 T1844 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection&name=onenodecollectioncore&action=CREATE&version=2&roles=none&wt=javabin&collection=onenodecollection} status=0 QTime=2497
[junit4:junit4] 2> 18825 T1806 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 18826 T1806 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C133_STATE=coll:collection1 core:collection1 props:{core=collection1, shard=shard2, state=recovering, collection=collection1, node_name=127.0.0.1:50250_xl%2Fr, base_url=http://127.0.0.1:50250/xl/r}
[junit4:junit4] 2> 19324 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47879/xl/r/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19324 T1884 C133 P50250 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50250/xl/r START replicas=[http://127.0.0.1:47879/xl/r/collection1/] nUpdates=100
[junit4:junit4] 2> 19325 T1884 C133 P50250 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19325 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19325 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19325 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19325 T1884 C133 P50250 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19325 T1884 C133 P50250 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47879/xl/r/collection1/. core=collection1
[junit4:junit4] 2> 19325 T1884 C133 P50250 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C134 name=collection1 org.apache.solr.core.SolrCore@4c1ac91b url=http://127.0.0.1:47879/xl/r/collection1 node=127.0.0.1:47879_xl%2Fr C134_STATE=coll:collection1 core:collection1 props:{core=collection1, shard=shard2, state=active, collection=collection1, node_name=127.0.0.1:47879_xl%2Fr, base_url=http://127.0.0.1:47879/xl/r, leader=true}
[junit4:junit4] 2> 19329 T1842 C134 P47879 REQ /get {getVersions=100&version=2&wt=javabin&qt=/get&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 19329 T1844 C134 P47879 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19330 T1844 C134 P47879 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55d89d83 lockFactory=org.apache.lucene.store.NativeFSLockFactory@733bba0f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19331 T1844 C134 P47879 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19331 T1844 C134 P47879 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55d89d83 lockFactory=org.apache.lucene.store.NativeFSLockFactory@733bba0f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55d89d83 lockFactory=org.apache.lucene.store.NativeFSLockFactory@733bba0f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19332 T1844 C134 P47879 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19332 T1844 C134 P47879 oass.SolrIndexSearcher.<init> Opening Searcher@549cdca0 realtime
[junit4:junit4] 2> 19332 T1844 C134 P47879 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19332 T1844 C134 P47879 /update {commit_end_point=true&version=2&softCommit=false&commit=true&wt=javabin&waitSearcher=true&openSearcher=false} {commit=} 0 3
[junit4:junit4] 2> 19333 T1884 C133 P50250 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19333 T1884 C133 P50250 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19335 T1843 C134 P47879 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19336 T1843 C134 P47879 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=2
[junit4:junit4] 2> 19336 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19336 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19336 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19338 T1842 C134 P47879 REQ /replication {generation=2&version=2&wt=javabin&qt=/replication&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 19338 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19339 T1884 C133 P50250 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index.20130310084117100 forceNew: false
[junit4:junit4] 2> 19339 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@eef4f20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61fbaceb; maxCacheMB=0.490234375 maxMergeSizeMB=0.08984375))) fullCopy=false
[junit4:junit4] 2> 19341 T1844 C134 P47879 REQ /replication {generation=2&file=segments_2&wt=filestream&qt=/replication&checksum=true&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19342 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19343 T1884 C133 P50250 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19343 T1884 C133 P50250 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19344 T1884 C133 P50250 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cda35ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@6887d56d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cda35ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@6887d56d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19344 T1884 C133 P50250 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19344 T1884 C133 P50250 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19345 T1884 C133 P50250 oass.SolrIndexSearcher.<init> Opening Searcher@847a44d main
[junit4:junit4] 2> 19345 T1883 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@847a44d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19346 T1884 C133 P50250 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@eef4f20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61fbaceb; maxCacheMB=0.490234375 maxMergeSizeMB=0.08984375)))
[junit4:junit4] 2> 19346 T1884 C133 P50250 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19346 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19346 T1884 C133 P50250 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19346 T1884 C133 P50250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19347 T1884 C133 P50250 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19827 T1806 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20287 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20288 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 20291 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50250_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50250/xl/r"}
[junit4:junit4] 2> 20303 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20303 T1836 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20303 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20303 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20303 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20829 T1806 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20830 T1806 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 20830 T1806 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20847 T1858 oejs.Response.sendError WARNING Committed before 404 Can not find: /xl/r/onenodecollectioncore/update
[junit4:junit4] 2> 20847 T1806 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46079 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@415193df
[junit4:junit4] 2> 20847 T1858 oejs.ServletHandler.doHandle WARNING /xl/r/onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 20848 T1889 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46079. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 20848 T1806 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 20848 T1889 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46079, initiating session
[junit4:junit4] 2> 20849 T1808 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55078
[junit4:junit4] 2> 20849 T1808 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55078
[junit4:junit4] 2> 20851 T1810 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d5263142d000b with negotiated timeout 10000 for client /127.0.0.1:55078
[junit4:junit4] 2> 20851 T1889 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46079, sessionid = 0x13d5263142d000b, negotiated timeout = 10000
[junit4:junit4] 2> 20851 T1890 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@415193df name:ZooKeeperConnection Watcher:127.0.0.1:46079 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 20851 T1806 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 20879 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d000b
[junit4:junit4] 2> 20879 T1890 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 20880 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55078 which had sessionid 0x13d5263142d000b
[junit4:junit4] 2> 20879 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d000b closed
[junit4:junit4] 2> 20880 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0004
[junit4:junit4] 2> 20881 T1836 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 20881 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55039 which had sessionid 0x13d5263142d0004
[junit4:junit4] 2> 20881 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0004 closed
[junit4:junit4] 2> 20883 T1806 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49610
[junit4:junit4] 2> 20883 T1806 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1813854017
[junit4:junit4] 2> 21809 T1829 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21810 T1829 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:49610_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49610/xl/r"}
[junit4:junit4] 2> 21814 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21814 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21814 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21814 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 22884 T1806 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 22885 T1806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22887 T1806 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@62a34fc
[junit4:junit4] 2> 22889 T1806 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 22890 T1806 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 22890 T1806 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 22890 T1806 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 22890 T1806 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 22891 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/index
[junit4:junit4] 2> 22891 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data/index
[junit4:junit4] 2> 22891 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data
[junit4:junit4] 2> 22891 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/control/data
[junit4:junit4] 2> 22893 T1829 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318153111011331-127.0.0.1:49610_xl%2Fr-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 22893 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0003
[junit4:junit4] 2> 22894 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 22894 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 22894 T1849 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 22894 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55035 which had sessionid 0x13d5263142d0003
[junit4:junit4] 2> 22894 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 22894 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0003 closed
[junit4:junit4] 2> 22896 T1865 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 22896 T1881 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 22896 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:delete cxid:0xbc zxid:0xce txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 22897 T1849 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 22898 T1849 oasc.Overseer.start Overseer (id=89318153111011334-127.0.0.1:47879_xl%2Fr-n_0000000001) starting
[junit4:junit4] 2> 22899 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0xc1 zxid:0xd0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 22899 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0xc2 zxid:0xd1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 22900 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0xc3 zxid:0xd2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 22900 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0006 type:create cxid:0xc4 zxid:0xd3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 22901 T1892 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 22902 T1891 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 22903 T1891 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22903 T1891 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:49610_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49610/xl/r"}
[junit4:junit4] 2> 22906 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 22906 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 22906 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 22915 T1806 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/xl/r,null}
[junit4:junit4] 2> 22968 T1806 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 47879
[junit4:junit4] 2> 22968 T1806 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1017801452
[junit4:junit4] 2> 24194 T1828 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 24194 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 24194 T1828 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 24195 T1828 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 24410 T1891 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24411 T1891 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47879_xl%2Fr_onenodecollectioncore",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 24414 T1891 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 24416 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 24416 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 24417 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 25971 T1806 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 25971 T1806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 25972 T1806 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 25974 T1806 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4c1ac91b
[junit4:junit4] 2> 25977 T1806 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25977 T1806 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 25977 T1806 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 25978 T1806 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 25980 T1806 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 25980 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1
[junit4:junit4] 2> 25981 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1
[junit4:junit4] 2> 25981 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/index
[junit4:junit4] 2> 25981 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty1/index
[junit4:junit4] 2> 25982 T1806 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@45a156b1
[junit4:junit4] 2> 25985 T1806 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25986 T1806 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 25986 T1806 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 25986 T1806 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 25987 T1806 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 25987 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection
[junit4:junit4] 2> 25987 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection
[junit4:junit4] 2> 25987 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/index
[junit4:junit4] 2> 25988 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362886857770/onenodecollection/index
[junit4:junit4] 2> 25989 T1891 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318153111011334-127.0.0.1:47879_xl%2Fr-n_0000000001) am no longer a leader.
[junit4:junit4] 2> 25989 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0006
[junit4:junit4] 2> 25990 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 25990 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55041 which had sessionid 0x13d5263142d0006
[junit4:junit4] 2> 25990 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0006 closed
[junit4:junit4] 2> 25990 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 25991 T1865 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 25991 T1881 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 25992 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:delete cxid:0x74 zxid:0xe4 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 25992 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:delete cxid:0x58 zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 25992 T1865 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 25993 T1881 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 25993 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x59 zxid:0xe6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25994 T1881 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 25994 T1865 oasc.Overseer.start Overseer (id=89318153111011336-127.0.0.1:36516_xl%2Fr-n_0000000002) starting
[junit4:junit4] 2> 25994 T1881 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 25995 T1881 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 25995 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x79 zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25995 T1881 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50250/xl/r/collection1/
[junit4:junit4] 2> 25995 T1881 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 25995 T1881 oasc.SyncStrategy.syncToMe http://127.0.0.1:50250/xl/r/collection1/ has no replicas
[junit4:junit4] 2> 25995 T1881 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50250/xl/r/collection1/
[junit4:junit4] 2> 25995 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x7a zxid:0xea txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25995 T1881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 25996 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x7b zxid:0xeb txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25997 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d0008 type:create cxid:0x7c zxid:0xec txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25997 T1894 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 25998 T1893 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 25999 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x61 zxid:0xee txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26001 T1893 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26001 T1893 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 26004 T1893 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 2> 26011 T1806 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/xl/r,null}
[junit4:junit4] 2> 26014 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26014 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26064 T1806 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 36516
[junit4:junit4] 2> 26064 T1806 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=11987235
[junit4:junit4] 2> 27066 T1806 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 27066 T1806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 27069 T1806 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6edfea78
[junit4:junit4] 2> 27071 T1806 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 27071 T1806 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 27072 T1806 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 27072 T1806 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 27073 T1806 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 27073 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/index
[junit4:junit4] 2> 27073 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2/index
[junit4:junit4] 2> 27074 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2
[junit4:junit4] 2> 27074 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty2
[junit4:junit4] 2> 27075 T1893 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318153111011336-127.0.0.1:36516_xl%2Fr-n_0000000002) am no longer a leader.
[junit4:junit4] 2> 27077 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d0008
[junit4:junit4] 2> 27077 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 27077 T1865 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 27078 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55057 which had sessionid 0x13d5263142d0008
[junit4:junit4] 2> 27078 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d0008 closed
[junit4:junit4] 2> 27079 T1881 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 27080 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:delete cxid:0x69 zxid:0x100 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 27080 T1881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 27082 T1881 oasc.Overseer.start Overseer (id=89318153111011338-127.0.0.1:50250_xl%2Fr-n_0000000003) starting
[junit4:junit4] 2> 27082 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x6e zxid:0x102 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27083 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x6f zxid:0x103 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27084 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x70 zxid:0x104 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27086 T1811 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d5263142d000a type:create cxid:0x71 zxid:0x105 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27087 T1896 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 27088 T1895 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 27089 T1895 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27090 T1895 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36516_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36516/xl/r"}
[junit4:junit4] 2> 27093 T1895 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36516_xl%2Fr",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36516/xl/r"}
[junit4:junit4] 2> 27095 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 27100 T1806 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/xl/r,null}
[junit4:junit4] 2> 27152 T1806 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 50250
[junit4:junit4] 2> 27152 T1806 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1469151341
[junit4:junit4] 2> 27290 T1849 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27290 T1849 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 27290 T1849 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27290 T1849 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 28154 T1806 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 28154 T1806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 28157 T1806 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7ee2adc0
[junit4:junit4] 2> 28161 T1806 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28162 T1806 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28162 T1806 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28162 T1806 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28163 T1806 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 28164 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index
[junit4:junit4] 2> 28164 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index
[junit4:junit4] 2> 28164 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3
[junit4:junit4] 2> 28164 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3
[junit4:junit4] 2> 28165 T1806 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index.20130310084117100
[junit4:junit4] 2> 28165 T1806 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362886857770/jetty3/index.20130310084117100
[junit4:junit4] 2> 28166 T1895 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318153111011338-127.0.0.1:50250_xl%2Fr-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 28166 T1811 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d5263142d000a
[junit4:junit4] 2> 28167 T1808 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55063 which had sessionid 0x13d5263142d000a
[junit4:junit4] 2> 28167 T1806 oaz.ZooKeeper.close Session: 0x13d5263142d000a closed
[junit4:junit4] 2> 28188 T1806 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/xl/r,null}
[junit4:junit4] 2> 28243 T1806 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 28243 T1806 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 28243 T1806 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 28243 T1806 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28244 T1811 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4] 2> 28244 T1806 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28244 T1810 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4] 2> 28245 T1806 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 28246 T1806 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:46079 46079
[junit4:junit4] 2> 28247 T1808 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 28247 T1806 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 28247 T1806 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 28248 T1806 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28248 T1806 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28248 T1806 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> / (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr (7)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"1":{
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "node_name":"127.0.0.1:49610_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49610/xl/r",
[junit4:junit4] 1> "leader":"true"}}}}},
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "shards":{
[junit4:junit4] 1> "shard2":{
[junit4:junit4] 1> "range":"0-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "2":{
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47879/xl/r",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "4":{
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:50250_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50250/xl/r"}}},
[junit4:junit4] 1> "shard1":{
[junit4:junit4] 1> "range":"80000000-ffffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"3":{
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:36516_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:36516/xl/r",
[junit4:junit4] 1> "leader":"true"}}}}},
[junit4:junit4] 1> "onenodecollection":{
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:47879_xl%2Fr_onenodecollectioncore":{
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "roles":"none",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"onenodecollection",
[junit4:junit4] 1> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47879/xl/r",
[junit4:junit4] 1> "leader":"true"}}}}}}
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/collections (3)
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89318153111011331-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:49610_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49610/xl/r"}
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89318153111011338-4-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89318153111011334-2-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89318153111011336-3-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (2)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:36516_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:36516/xl/r"}
[junit4:junit4] 1> /solr/collections/onenodecollection (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "configName":"conf1"}
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election/89318153111011334-127.0.0.1:47879_xl%2Fr_onenodecollectioncore-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "node_name":"127.0.0.1:47879_xl%2Fr",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47879/xl/r"}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/configs (1)
[junit4:junit4] 1> /solr/configs/conf1 (9)
[junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4] 1> "timestamp": 1332070464,
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "base": "USD",
[junit4:junit4] 1> "rates": {
[junit4:junit4] 1> "USD": 1,
[junit4:junit4] 1> "JPY": 81.29,
[junit4:junit4] 1> "EUR": 2.5,
[junit4:junit4] 1> "GBP": 0.5,
[junit4:junit4] 1> "MXN": 2.0
[junit4:junit4] 1> }
[junit4:junit4] 1> }
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/live_nodes (4)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:36516_xl%2Fr (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:49610_xl%2Fr (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:50250_xl%2Fr (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:47879_xl%2Fr (0)
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89318153111011334-127.0.0.1:47879_xl%2Fr-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89318153111011331-127.0.0.1:49610_xl%2Fr-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89318153111011338-127.0.0.1:50250_xl%2Fr-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89318153111011336-127.0.0.1:36516_xl%2Fr-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89318153111011331-127.0.0.1:49610_xl%2Fr-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=F25AC9C02AD88397 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_PT -Dtests.timezone=Asia/Samarkand -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 28.3s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:36516/xl/r/onenodecollectioncore returned non ok status:404, message:Can not find: /xl/r/onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F25AC9C02AD88397:73BC47D85D87E3AB]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:200)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 28300 T1806 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 28304 T1805 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 28378 T1865 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 28378 T1865 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 28378 T1865 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 29238 T1809 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 29467 T1881 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 29467 T1881 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 29467 T1881 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 29468 T1881 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=pt_PT, timezone=Asia/Samarkand
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=26921904,total=170196992
[junit4:junit4] 2> NOTE: All tests run in this JVM: [XmlUpdateRequestHandlerTest, ShardRoutingCustomTest, TestRTGBase, TestPartialUpdateDeduplication, SolrPluginUtilsTest, TestArbitraryIndexDir, ZkSolrClientTest, CollectionsAPIDistributedZkTest, CoreContainerCoreInitFailuresTest, TestBinaryField, IndexSchemaRuntimeFieldTest, TestAtomicUpdateErrorCases, IndexBasedSpellCheckerTest, TestDynamicFieldResource, TestMultiCoreConfBootstrap, SuggesterTSTTest, TestDistributedSearch, JSONWriterTest, TestCSVLoader, DefaultValueUpdateProcessorTest, OutputWriterTest, TestStressLucene, TestSuggestSpellingConverter, TestSolrDiscoveryProperties, SolrRequestParserTest, NumericFieldsTest, TestLazyCores, BadIndexSchemaTest, TestLMJelinekMercerSimilarityFactory, TestRecovery, OpenExchangeRatesOrgProviderTest, TestLuceneMatchVersion, SimplePostToolTest, ZkNodePropsTest, TestCodecSupport, TestBM25SimilarityFactory, CopyFieldTest, TestDefaultSimilarityFactory, StandardRequestHandlerTest, CurrencyFieldXmlFileTest, DocValuesMultiTest, TestFiltering, TestJmxMonitoredMap, TimeZoneUtilsTest, TestHashPartitioner, EchoParamsTest, UniqFieldsUpdateProcessorFactoryTest, TestFieldResource, TestStressReorder, TermVectorComponentDistributedTest, TestUtils, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, DistanceFunctionTest, NoCacheHeaderTest, TestWordDelimiterFilterFactory, SuggesterWFSTTest, HighlighterConfigTest, TestFastOutputStream, TestZkChroot, TestDistributedGrouping, TestSolrJ, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 29.59s, 1 test, 1 error <<< FAILURES!
[...truncated 423 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:877: There were test failures: 269 suites, 1137 tests, 1 error, 13 ignored (7 assumptions)
Total time: 40 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b79) - Build #
4646 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4646/
Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([F8D6F0A4F3887AE4:79307EBC84D71AD8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:57006/_v/onenodecollectioncore returned non ok status:404, message:Can not find: /_v/onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:57006/_v/onenodecollectioncore returned non ok status:404, message:Can not find: /_v/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([F8D6F0A4F3887AE4:79307EBC84D71AD8]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:200)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 8998 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T1075 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_v/
[junit4:junit4] 2> 5 T1075 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680
[junit4:junit4] 2> 6 T1075 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 10 T1076 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 12 T1076 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 13 T1076 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 13 T1076 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 13 T1076 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 16 T1076 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T1075 oasc.ZkTestServer.run start zk server on port:54651
[junit4:junit4] 2> 109 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1299d07
[junit4:junit4] 2> 111 T1081 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 111 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 112 T1081 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 112 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49516
[junit4:junit4] 2> 113 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49516
[junit4:junit4] 2> 113 T1079 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 249 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440000 with negotiated timeout 10000 for client /127.0.0.1:49516
[junit4:junit4] 2> 249 T1081 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440000, negotiated timeout = 10000
[junit4:junit4] 2> 250 T1082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1299d07 name:ZooKeeperConnection Watcher:127.0.0.1:54651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 250 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 250 T1075 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 255 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440000
[junit4:junit4] 2> 255 T1082 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 255 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49516 which had sessionid 0x13d52b36a440000
[junit4:junit4] 2> 255 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440000 closed
[junit4:junit4] 2> 256 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ee7252
[junit4:junit4] 2> 257 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 257 T1083 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 257 T1083 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 257 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49518
[junit4:junit4] 2> 258 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49518
[junit4:junit4] 2> 258 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440001 with negotiated timeout 10000 for client /127.0.0.1:49518
[junit4:junit4] 2> 258 T1083 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440001, negotiated timeout = 10000
[junit4:junit4] 2> 258 T1084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ee7252 name:ZooKeeperConnection Watcher:127.0.0.1:54651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 259 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 259 T1075 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 265 T1075 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 273 T1075 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 283 T1075 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 286 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 286 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 294 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 295 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 307 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 308 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 310 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 312 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 320 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 321 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 325 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 325 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 330 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 331 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 335 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 335 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 337 T1075 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 338 T1075 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 340 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440001
[junit4:junit4] 2> 340 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49518 which had sessionid 0x13d52b36a440001
[junit4:junit4] 2> 340 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440001 closed
[junit4:junit4] 2> 341 T1084 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 439 T1075 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 444 T1075 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54828
[junit4:junit4] 2> 452 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 452 T1075 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 453 T1075 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016
[junit4:junit4] 2> 453 T1075 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/solr.xml
[junit4:junit4] 2> 454 T1075 oasc.CoreContainer.<init> New CoreContainer 20031513
[junit4:junit4] 2> 454 T1075 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/'
[junit4:junit4] 2> 455 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/'
[junit4:junit4] 2> 481 T1075 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 482 T1075 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 482 T1075 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 482 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 483 T1075 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 483 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 484 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 484 T1075 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 485 T1075 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 485 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 494 T1075 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 513 T1075 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54651/solr
[junit4:junit4] 2> 513 T1075 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 514 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d5e2e
[junit4:junit4] 2> 515 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 521 T1094 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 522 T1094 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 522 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49519
[junit4:junit4] 2> 523 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49519
[junit4:junit4] 2> 524 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440002 with negotiated timeout 20000 for client /127.0.0.1:49519
[junit4:junit4] 2> 524 T1094 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440002, negotiated timeout = 20000
[junit4:junit4] 2> 524 T1095 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d5e2e name:ZooKeeperConnection Watcher:127.0.0.1:54651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 524 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 532 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440002
[junit4:junit4] 2> 533 T1095 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 533 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49519 which had sessionid 0x13d52b36a440002
[junit4:junit4] 2> 533 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440002 closed
[junit4:junit4] 2> 534 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 537 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@cf7d97
[junit4:junit4] 2> 539 T1096 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 540 T1096 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 540 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49520
[junit4:junit4] 2> 540 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49520
[junit4:junit4] 2> 539 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 542 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440003 with negotiated timeout 20000 for client /127.0.0.1:49520
[junit4:junit4] 2> 542 T1096 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440003, negotiated timeout = 20000
[junit4:junit4] 2> 542 T1097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cf7d97 name:ZooKeeperConnection Watcher:127.0.0.1:54651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 542 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 544 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 547 T1075 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 549 T1075 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54828__v
[junit4:junit4] 2> 550 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54828__v Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54828__v
[junit4:junit4] 2> 551 T1075 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54828__v
[junit4:junit4] 2> 555 T1075 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 563 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 564 T1075 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 567 T1075 oasc.Overseer.start Overseer (id=89318498152742915-127.0.0.1:54828__v-n_0000000000) starting
[junit4:junit4] 2> 568 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 569 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 569 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 570 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 571 T1099 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 571 T1075 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 577 T1075 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 580 T1075 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 584 T1098 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 586 T1100 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/collection1
[junit4:junit4] 2> 586 T1100 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 589 T1100 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 589 T1100 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 590 T1100 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/collection1/'
[junit4:junit4] 2> 591 T1100 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/collection1/lib/README' to classloader
[junit4:junit4] 2> 591 T1100 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 630 T1100 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 687 T1100 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 688 T1100 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 696 T1100 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1157 T1100 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1165 T1100 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1168 T1100 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1192 T1100 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1195 T1100 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1199 T1100 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1201 T1100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1201 T1100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1202 T1100 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1203 T1100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1203 T1100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1203 T1100 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362892123016/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/
[junit4:junit4] 2> 1204 T1100 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a109af
[junit4:junit4] 2> 1204 T1100 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1205 T1100 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data forceNew: false
[junit4:junit4] 2> 1206 T1100 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/index/
[junit4:junit4] 2> 1206 T1100 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1206 T1100 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/index forceNew: false
[junit4:junit4] 2> 1209 T1100 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@f40259 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b75632; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1210 T1100 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1212 T1100 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1213 T1100 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1213 T1100 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1214 T1100 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1214 T1100 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1214 T1100 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1215 T1100 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1215 T1100 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1215 T1100 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1217 T1100 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1220 T1100 oass.SolrIndexSearcher.<init> Opening Searcher@e8181a main
[junit4:junit4] 2> 1220 T1100 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/tlog
[junit4:junit4] 2> 1221 T1100 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1221 T1100 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1226 T1100 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1227 T1100 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1230 T1101 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e8181a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1231 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2093 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2095 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54828/_v",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54828__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 2095 T1098 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2095 T1098 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2096 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2109 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2234 T1100 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2234 T1100 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54828/_v collection:control_collection shard:shard1
[junit4:junit4] 2> 2236 T1100 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2245 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2246 T1100 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2246 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2248 T1100 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2248 T1100 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2249 T1100 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54828/_v/collection1/
[junit4:junit4] 2> 2249 T1100 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2249 T1100 oasc.SyncStrategy.syncToMe http://127.0.0.1:54828/_v/collection1/ has no replicas
[junit4:junit4] 2> 2249 T1100 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54828/_v/collection1/
[junit4:junit4] 2> 2249 T1100 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2253 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3618 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3626 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3659 T1100 oasc.ZkController.register We are http://127.0.0.1:54828/_v/collection1/ and leader is http://127.0.0.1:54828/_v/collection1/
[junit4:junit4] 2> 3660 T1100 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54828/_v
[junit4:junit4] 2> 3660 T1100 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3661 T1100 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3661 T1100 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3664 T1100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3666 T1075 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3666 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3667 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3672 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3673 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f210e2
[junit4:junit4] 2> 3674 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3674 T1103 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3675 T1103 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 3675 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49521
[junit4:junit4] 2> 3675 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49521
[junit4:junit4] 2> 3676 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440004 with negotiated timeout 10000 for client /127.0.0.1:49521
[junit4:junit4] 2> 3677 T1103 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440004, negotiated timeout = 10000
[junit4:junit4] 2> 3678 T1104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f210e2 name:ZooKeeperConnection Watcher:127.0.0.1:54651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3679 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3681 T1075 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3683 T1075 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3772 T1075 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3774 T1075 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49616
[junit4:junit4] 2> 3774 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3775 T1075 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3775 T1075 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359
[junit4:junit4] 2> 3775 T1075 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/solr.xml
[junit4:junit4] 2> 3776 T1075 oasc.CoreContainer.<init> New CoreContainer 9810073
[junit4:junit4] 2> 3777 T1075 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/'
[junit4:junit4] 2> 3777 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/'
[junit4:junit4] 2> 3798 T1075 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3799 T1075 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3800 T1075 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3800 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3801 T1075 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3801 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3801 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3802 T1075 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3802 T1075 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3803 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3822 T1075 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3837 T1075 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54651/solr
[junit4:junit4] 2> 3838 T1075 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3838 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e72199
[junit4:junit4] 2> 3839 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3839 T1114 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3840 T1114 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 3840 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49522
[junit4:junit4] 2> 3840 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49522
[junit4:junit4] 2> 3841 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440005 with negotiated timeout 20000 for client /127.0.0.1:49522
[junit4:junit4] 2> 3841 T1114 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440005, negotiated timeout = 20000
[junit4:junit4] 2> 3842 T1115 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e72199 name:ZooKeeperConnection Watcher:127.0.0.1:54651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3856 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3858 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440005
[junit4:junit4] 2> 3859 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49522 which had sessionid 0x13d52b36a440005
[junit4:junit4] 2> 3860 T1115 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3860 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440005 closed
[junit4:junit4] 2> 3860 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3863 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e87448
[junit4:junit4] 2> 3863 T1116 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3863 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3864 T1116 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 3864 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49523
[junit4:junit4] 2> 3864 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49523
[junit4:junit4] 2> 3865 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440006 with negotiated timeout 20000 for client /127.0.0.1:49523
[junit4:junit4] 2> 3865 T1116 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440006, negotiated timeout = 20000
[junit4:junit4] 2> 3866 T1117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e87448 name:ZooKeeperConnection Watcher:127.0.0.1:54651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3866 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3867 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3867 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3874 T1075 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4880 T1075 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49616__v
[junit4:junit4] 2> 4881 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49616__v Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49616__v
[junit4:junit4] 2> 4882 T1075 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49616__v
[junit4:junit4] 2> 4885 T1097 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4885 T1104 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4885 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4885 T1117 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4898 T1118 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/collection1
[junit4:junit4] 2> 4898 T1118 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4900 T1118 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4900 T1118 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4902 T1118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/collection1/'
[junit4:junit4] 2> 4902 T1118 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/collection1/lib/README' to classloader
[junit4:junit4] 2> 4902 T1118 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4944 T1118 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4989 T1118 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4990 T1118 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4995 T1118 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5132 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5132 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54828/_v",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54828__v",
[junit4:junit4] 2> "state":"active"}
[junit4:junit4] 2> 5137 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5137 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5137 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5425 T1118 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5433 T1118 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5436 T1118 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5454 T1118 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5458 T1118 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5461 T1118 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5462 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5462 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5462 T1118 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5463 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5463 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5464 T1118 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/
[junit4:junit4] 2> 5464 T1118 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a109af
[junit4:junit4] 2> 5464 T1118 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5465 T1118 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1 forceNew: false
[junit4:junit4] 2> 5465 T1118 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/index/
[junit4:junit4] 2> 5466 T1118 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5466 T1118 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/index forceNew: false
[junit4:junit4] 2> 5468 T1118 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1429991 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfee4d; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5468 T1118 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5471 T1118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5476 T1118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5477 T1118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5477 T1118 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5478 T1118 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5478 T1118 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5479 T1118 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5479 T1118 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5479 T1118 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5482 T1118 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5484 T1118 oass.SolrIndexSearcher.<init> Opening Searcher@121fd7d main
[junit4:junit4] 2> 5484 T1118 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/tlog
[junit4:junit4] 2> 5485 T1118 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5488 T1118 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5496 T1118 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5496 T1118 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5498 T1119 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@121fd7d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6642 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6643 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 6643 T1098 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6644 T1098 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 6656 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6656 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6656 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7499 T1118 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7499 T1118 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49616/_v collection:collection1 shard:shard2
[junit4:junit4] 2> 7500 T1118 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 7508 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7508 T1118 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7509 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7511 T1118 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7511 T1118 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7511 T1118 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49616/_v/collection1/
[junit4:junit4] 2> 7512 T1118 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7512 T1118 oasc.SyncStrategy.syncToMe http://127.0.0.1:49616/_v/collection1/ has no replicas
[junit4:junit4] 2> 7512 T1118 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49616/_v/collection1/
[junit4:junit4] 2> 7513 T1118 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 7518 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8163 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8198 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8198 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8198 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8224 T1118 oasc.ZkController.register We are http://127.0.0.1:49616/_v/collection1/ and leader is http://127.0.0.1:49616/_v/collection1/
[junit4:junit4] 2> 8224 T1118 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49616/_v
[junit4:junit4] 2> 8225 T1118 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8225 T1118 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8225 T1118 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8229 T1118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8230 T1075 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8231 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8232 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8290 T1075 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8292 T1075 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57006
[junit4:junit4] 2> 8293 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8293 T1075 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8294 T1075 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912
[junit4:junit4] 2> 8294 T1075 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/solr.xml
[junit4:junit4] 2> 8294 T1075 oasc.CoreContainer.<init> New CoreContainer 8309423
[junit4:junit4] 2> 8295 T1075 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/'
[junit4:junit4] 2> 8295 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/'
[junit4:junit4] 2> 8312 T1075 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8312 T1075 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8313 T1075 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8313 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8313 T1075 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8313 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8314 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8314 T1075 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8314 T1075 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8315 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8320 T1075 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8337 T1075 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54651/solr
[junit4:junit4] 2> 8337 T1075 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8338 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a76a6
[junit4:junit4] 2> 8338 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8339 T1130 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8339 T1130 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 8339 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49527
[junit4:junit4] 2> 8340 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49527
[junit4:junit4] 2> 8340 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440007 with negotiated timeout 20000 for client /127.0.0.1:49527
[junit4:junit4] 2> 8340 T1130 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440007, negotiated timeout = 20000
[junit4:junit4] 2> 8341 T1131 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a76a6 name:ZooKeeperConnection Watcher:127.0.0.1:54651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8341 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8342 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440007
[junit4:junit4] 2> 8343 T1131 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8343 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49527 which had sessionid 0x13d52b36a440007
[junit4:junit4] 2> 8343 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440007 closed
[junit4:junit4] 2> 8343 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8347 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@dbf3f5
[junit4:junit4] 2> 8348 T1132 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8348 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8349 T1132 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 8349 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49528
[junit4:junit4] 2> 8349 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49528
[junit4:junit4] 2> 8350 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440008 with negotiated timeout 20000 for client /127.0.0.1:49528
[junit4:junit4] 2> 8350 T1132 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440008, negotiated timeout = 20000
[junit4:junit4] 2> 8351 T1133 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dbf3f5 name:ZooKeeperConnection Watcher:127.0.0.1:54651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8351 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8352 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8353 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8354 T1075 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9356 T1075 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57006__v
[junit4:junit4] 2> 9357 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57006__v Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57006__v
[junit4:junit4] 2> 9358 T1075 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57006__v
[junit4:junit4] 2> 9360 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9360 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9361 T1104 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9361 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9361 T1133 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9362 T1117 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9362 T1097 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9365 T1134 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/collection1
[junit4:junit4] 2> 9365 T1134 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9366 T1134 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9366 T1134 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9367 T1134 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/collection1/'
[junit4:junit4] 2> 9367 T1134 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/collection1/lib/README' to classloader
[junit4:junit4] 2> 9367 T1134 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9389 T1134 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9423 T1134 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9424 T1134 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9427 T1134 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9706 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9706 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"active"}
[junit4:junit4] 2> 9710 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9710 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9710 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9710 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9751 T1134 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9755 T1134 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9758 T1134 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9778 T1134 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9781 T1134 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9784 T1134 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9785 T1134 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9786 T1134 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9786 T1134 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9788 T1134 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9788 T1134 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9788 T1134 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362892130912/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/
[junit4:junit4] 2> 9789 T1134 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a109af
[junit4:junit4] 2> 9789 T1134 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9791 T1134 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2 forceNew: false
[junit4:junit4] 2> 9791 T1134 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/index/
[junit4:junit4] 2> 9791 T1134 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9792 T1134 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/index forceNew: false
[junit4:junit4] 2> 9794 T1134 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@382894 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11b575b; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9795 T1134 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9797 T1134 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9797 T1134 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9797 T1134 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9798 T1134 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9798 T1134 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9798 T1134 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9798 T1134 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9799 T1134 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9799 T1134 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9801 T1134 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9803 T1134 oass.SolrIndexSearcher.<init> Opening Searcher@13c3f91 main
[junit4:junit4] 2> 9803 T1134 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/tlog
[junit4:junit4] 2> 9803 T1134 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9803 T1134 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9809 T1135 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13c3f91 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9811 T1134 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9812 T1134 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11215 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11216 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57006/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:57006__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 11216 T1098 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11216 T1098 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11319 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11319 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11319 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11319 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11814 T1134 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11814 T1134 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57006/_v collection:collection1 shard:shard1
[junit4:junit4] 2> 11816 T1134 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 11822 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 11822 T1134 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11823 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11824 T1134 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11825 T1134 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11825 T1134 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57006/_v/collection1/
[junit4:junit4] 2> 11825 T1134 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11825 T1134 oasc.SyncStrategy.syncToMe http://127.0.0.1:57006/_v/collection1/ has no replicas
[junit4:junit4] 2> 11826 T1134 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57006/_v/collection1/
[junit4:junit4] 2> 11826 T1134 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 11829 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12824 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12869 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12869 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12869 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12869 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12883 T1134 oasc.ZkController.register We are http://127.0.0.1:57006/_v/collection1/ and leader is http://127.0.0.1:57006/_v/collection1/
[junit4:junit4] 2> 12884 T1134 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57006/_v
[junit4:junit4] 2> 12884 T1134 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12884 T1134 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12884 T1134 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12886 T1134 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12887 T1075 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12888 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12888 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12945 T1075 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12948 T1075 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59118
[junit4:junit4] 2> 12949 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12949 T1075 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12949 T1075 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566
[junit4:junit4] 2> 12950 T1075 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/solr.xml
[junit4:junit4] 2> 12950 T1075 oasc.CoreContainer.<init> New CoreContainer 24900277
[junit4:junit4] 2> 12950 T1075 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/'
[junit4:junit4] 2> 12951 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/'
[junit4:junit4] 2> 12966 T1075 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12967 T1075 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12967 T1075 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12967 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12968 T1075 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12968 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12968 T1075 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12969 T1075 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12969 T1075 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12969 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12974 T1075 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12983 T1075 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54651/solr
[junit4:junit4] 2> 12983 T1075 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12983 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5bcb79
[junit4:junit4] 2> 12984 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12985 T1146 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12986 T1146 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 12986 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49532
[junit4:junit4] 2> 12986 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49532
[junit4:junit4] 2> 12987 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a440009 with negotiated timeout 20000 for client /127.0.0.1:49532
[junit4:junit4] 2> 12987 T1146 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a440009, negotiated timeout = 20000
[junit4:junit4] 2> 12988 T1147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bcb79 name:ZooKeeperConnection Watcher:127.0.0.1:54651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12988 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12990 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440009
[junit4:junit4] 2> 12991 T1147 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12991 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49532 which had sessionid 0x13d52b36a440009
[junit4:junit4] 2> 12991 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440009 closed
[junit4:junit4] 2> 12992 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12994 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e0298
[junit4:junit4] 2> 12995 T1148 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12995 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12995 T1148 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 12996 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49533
[junit4:junit4] 2> 12996 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49533
[junit4:junit4] 2> 12997 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a44000a with negotiated timeout 20000 for client /127.0.0.1:49533
[junit4:junit4] 2> 12997 T1148 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a44000a, negotiated timeout = 20000
[junit4:junit4] 2> 12997 T1149 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e0298 name:ZooKeeperConnection Watcher:127.0.0.1:54651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12997 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12998 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12999 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13001 T1075 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14003 T1075 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59118__v
[junit4:junit4] 2> 14004 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59118__v Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59118__v
[junit4:junit4] 2> 14005 T1075 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59118__v
[junit4:junit4] 2> 14007 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14007 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14008 T1104 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14008 T1097 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14008 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14008 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14008 T1149 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14009 T1117 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14009 T1133 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14022 T1150 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/collection1
[junit4:junit4] 2> 14022 T1150 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14023 T1150 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14023 T1150 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14024 T1150 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/collection1/'
[junit4:junit4] 2> 14025 T1150 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/collection1/lib/README' to classloader
[junit4:junit4] 2> 14025 T1150 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14047 T1150 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14073 T1150 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14074 T1150 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14085 T1150 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14376 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14377 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57006/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:57006__v",
[junit4:junit4] 2> "state":"active"}
[junit4:junit4] 2> 14381 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14381 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14381 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14381 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14381 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14414 T1150 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14419 T1150 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14421 T1150 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14432 T1150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14435 T1150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14448 T1150 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14449 T1150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14449 T1150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14449 T1150 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14450 T1150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14450 T1150 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14450 T1150 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362892135566/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/
[junit4:junit4] 2> 14450 T1150 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a109af
[junit4:junit4] 2> 14451 T1150 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14451 T1150 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3 forceNew: false
[junit4:junit4] 2> 14451 T1150 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index/
[junit4:junit4] 2> 14452 T1150 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14452 T1150 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index forceNew: false
[junit4:junit4] 2> 14453 T1150 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1d2a467 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0c72f; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14453 T1150 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14455 T1150 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14455 T1150 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14456 T1150 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14456 T1150 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14456 T1150 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14456 T1150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14457 T1150 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14457 T1150 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14457 T1150 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14460 T1150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14462 T1150 oass.SolrIndexSearcher.<init> Opening Searcher@32b05a main
[junit4:junit4] 2> 14462 T1150 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/tlog
[junit4:junit4] 2> 14462 T1150 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14462 T1150 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14466 T1151 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32b05a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14467 T1150 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14467 T1150 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15886 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15887 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59118/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:59118__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 15887 T1098 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15887 T1098 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 15892 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15892 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15892 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15892 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15892 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16469 T1150 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16469 T1150 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59118/_v collection:collection1 shard:shard2
[junit4:junit4] 2> 16473 T1150 oasc.ZkController.register We are http://127.0.0.1:59118/_v/collection1/ and leader is http://127.0.0.1:49616/_v/collection1/
[junit4:junit4] 2> 16473 T1150 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59118/_v
[junit4:junit4] 2> 16473 T1150 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16473 T1150 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C58 name=collection1 org.apache.solr.core.SolrCore@c68fa0 url=http://127.0.0.1:59118/_v/collection1 node=127.0.0.1:59118__v C58_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:59118/_v, collection=collection1, core=collection1, node_name=127.0.0.1:59118__v, state=down}
[junit4:junit4] 2> 16474 T1152 C58 P59118 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16474 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16474 T1150 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16474 T1152 C58 P59118 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16475 T1152 C58 P59118 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16476 T1152 C58 P59118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16475 T1075 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16476 T1075 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16477 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16481 T1075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16482 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16487 T1111 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/onenodecollectioncore
[junit4:junit4] 2> 16488 T1111 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 16489 T1111 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 16489 T1111 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 16490 T1111 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 16490 T1111 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 16492 T1111 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 16493 T1111 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/onenodecollectioncore/'
[junit4:junit4] 2> 16516 T1111 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 16554 T1111 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16555 T1111 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16559 T1111 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16919 T1111 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16923 T1111 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16926 T1111 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16940 T1111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16943 T1111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16946 T1111 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16947 T1111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16947 T1111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16947 T1111 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16948 T1111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16949 T1111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16949 T1111 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362892126359/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/
[junit4:junit4] 2> 16949 T1111 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a109af
[junit4:junit4] 2> 16949 T1111 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16950 T1111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection forceNew: false
[junit4:junit4] 2> 16950 T1111 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/index/
[junit4:junit4] 2> 16951 T1111 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16951 T1111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/index forceNew: false
[junit4:junit4] 2> 16952 T1111 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@18fda38 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a1beb6; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16953 T1111 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16954 T1111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16954 T1111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16955 T1111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16955 T1111 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16956 T1111 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16956 T1111 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16956 T1111 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16957 T1111 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16957 T1111 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16960 T1111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16963 T1111 oass.SolrIndexSearcher.<init> Opening Searcher@20af95 main
[junit4:junit4] 2> 16963 T1111 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/tlog
[junit4:junit4] 2> 16964 T1111 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16965 T1111 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16968 T1154 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@20af95 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16969 T1111 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 17397 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17398 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59118/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:59118__v",
[junit4:junit4] 2> "state":"recovering"}
[junit4:junit4] 2> 17401 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 17401 T1098 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 17401 T1098 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17409 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17409 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17409 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17409 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17409 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17479 T1110 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&nodeName=127.0.0.1:59118__v&core=collection1&action=PREPRECOVERY&version=2&onlyIfLeader=true&checkLive=true&state=recovering&wt=javabin} status=0 QTime=1000
[junit4:junit4] 2> 17970 T1111 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 17971 T1111 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:49616/_v collection:onenodecollection shard:shard1
[junit4:junit4] 2> 17973 T1111 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 17983 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:delete cxid:0xa1 zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 17984 T1111 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 17985 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0xa2 zxid:0xae txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17987 T1111 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 17988 T1111 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 17988 T1111 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49616/_v/onenodecollectioncore/
[junit4:junit4] 2> 17989 T1111 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 17989 T1111 oasc.SyncStrategy.syncToMe http://127.0.0.1:49616/_v/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 17990 T1111 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49616/_v/onenodecollectioncore/
[junit4:junit4] 2> 17990 T1111 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 17996 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0xac zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18915 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18941 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18941 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18941 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18941 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18941 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18951 T1111 oasc.ZkController.register We are http://127.0.0.1:49616/_v/onenodecollectioncore/ and leader is http://127.0.0.1:49616/_v/onenodecollectioncore/
[junit4:junit4] 2> 18951 T1111 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:49616/_v
[junit4:junit4] 2> 18951 T1111 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 18952 T1111 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 18953 T1111 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18954 T1111 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {roles=none&collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection&numShards=1&action=CREATE&name=onenodecollectioncore&version=2&wt=javabin} status=0 QTime=2467
[junit4:junit4] 2> 18955 T1075 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 18955 T1075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C58_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:59118/_v, collection=collection1, shard=shard2, core=collection1, node_name=127.0.0.1:59118__v, state=recovering}
[junit4:junit4] 2> 19480 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49616/_v/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19481 T1152 C58 P59118 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59118/_v START replicas=[http://127.0.0.1:49616/_v/collection1/] nUpdates=100
[junit4:junit4] 2> 19481 T1152 C58 P59118 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19481 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19481 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19482 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19482 T1152 C58 P59118 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19482 T1152 C58 P59118 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49616/_v/collection1/. core=collection1
[junit4:junit4] 2> 19482 T1152 C58 P59118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C59 name=collection1 org.apache.solr.core.SolrCore@13bf15c url=http://127.0.0.1:49616/_v/collection1 node=127.0.0.1:49616__v C59_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:49616/_v, collection=collection1, shard=shard2, core=collection1, node_name=127.0.0.1:49616__v, state=active, leader=true}
[junit4:junit4] 2> 19487 T1112 C59 P49616 REQ /get {qt=/get&getVersions=100&version=2&distrib=false&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 19489 T1110 C59 P49616 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19490 T1110 C59 P49616 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1429991 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfee4d; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19491 T1110 C59 P49616 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19491 T1110 C59 P49616 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1429991 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfee4d; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1429991 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfee4d; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19492 T1110 C59 P49616 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19492 T1110 C59 P49616 oass.SolrIndexSearcher.<init> Opening Searcher@7d967b realtime
[junit4:junit4] 2> 19492 T1110 C59 P49616 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19493 T1110 C59 P49616 /update {commit=true&openSearcher=false&softCommit=false&commit_end_point=true&version=2&waitSearcher=true&wt=javabin} {commit=} 0 5
[junit4:junit4] 2> 19494 T1152 C58 P59118 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19494 T1152 C58 P59118 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19495 T1111 C59 P49616 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19496 T1111 C59 P49616 REQ /replication {qt=/replication&command=indexversion&version=2&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 19496 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19496 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19497 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19499 T1112 C59 P49616 REQ /replication {qt=/replication&command=filelist&version=2&generation=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 19499 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19500 T1152 C58 P59118 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index.20130310060902174 forceNew: false
[junit4:junit4] 2> 19501 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12bdc85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@190e36b; maxCacheMB=0.888671875 maxMergeSizeMB=0.9580078125)) fullCopy=false
[junit4:junit4] 2> 19503 T1110 C59 P49616 REQ /replication {qt=/replication&command=filecontent&generation=2&checksum=true&wt=filestream&file=segments_2} status=0 QTime=0
[junit4:junit4] 2> 19504 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19505 T1152 C58 P59118 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19505 T1152 C58 P59118 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19506 T1152 C58 P59118 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1d2a467 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0c72f; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1d2a467 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0c72f; maxCacheMB=0.1689453125 maxMergeSizeMB=0.6044921875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19506 T1152 C58 P59118 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19506 T1152 C58 P59118 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19506 T1152 C58 P59118 oass.SolrIndexSearcher.<init> Opening Searcher@a319 main
[junit4:junit4] 2> 19507 T1151 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a319 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19508 T1152 C58 P59118 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12bdc85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@190e36b; maxCacheMB=0.888671875 maxMergeSizeMB=0.9580078125))
[junit4:junit4] 2> 19508 T1152 C58 P59118 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19508 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19508 T1152 C58 P59118 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19508 T1152 C58 P59118 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19509 T1152 C58 P59118 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19957 T1075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20447 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20448 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"active"}
[junit4:junit4] 2> 20451 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59118/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:59118__v",
[junit4:junit4] 2> "state":"active"}
[junit4:junit4] 2> 20455 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20455 T1104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20455 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20455 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20455 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20959 T1075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20960 T1075 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 20960 T1075 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20971 T1129 oejs.Response.sendError WARNING Committed before 404 Can not find: /_v/onenodecollectioncore/update
[junit4:junit4] 2> 20972 T1075 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54651 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@180e92d
[junit4:junit4] 2> 20972 T1129 oejs.ServletHandler.doHandle WARNING /_v/onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 20972 T1075 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 20973 T1157 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54651. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 20973 T1157 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54651, initiating session
[junit4:junit4] 2> 20973 T1077 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49551
[junit4:junit4] 2> 20974 T1077 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49551
[junit4:junit4] 2> 20975 T1079 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d52b36a44000b with negotiated timeout 10000 for client /127.0.0.1:49551
[junit4:junit4] 2> 20975 T1157 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54651, sessionid = 0x13d52b36a44000b, negotiated timeout = 10000
[junit4:junit4] 2> 20975 T1158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@180e92d name:ZooKeeperConnection Watcher:127.0.0.1:54651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 20975 T1075 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 21014 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a44000b
[junit4:junit4] 2> 21015 T1158 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 21015 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49551 which had sessionid 0x13d52b36a44000b
[junit4:junit4] 2> 21015 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a44000b closed
[junit4:junit4] 2> 21016 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440004
[junit4:junit4] 2> 21016 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49521 which had sessionid 0x13d52b36a440004
[junit4:junit4] 2> 21016 T1104 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 21016 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440004 closed
[junit4:junit4] 2> 21019 T1075 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 54828
[junit4:junit4] 2> 21020 T1075 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=20031513
[junit4:junit4] 2> 21961 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21961 T1098 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54828/_v",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54828__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 21999 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21999 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21999 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21999 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 23021 T1075 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 23022 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23024 T1075 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1e1a2e3
[junit4:junit4] 2> 23035 T1075 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 23036 T1075 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 23036 T1075 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 23037 T1075 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 23037 T1075 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 23038 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/index
[junit4:junit4] 2> 23039 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data/index
[junit4:junit4] 2> 23039 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data
[junit4:junit4] 2> 23039 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/control/data
[junit4:junit4] 2> 23040 T1098 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318498152742915-127.0.0.1:54828__v-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 23041 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440003
[junit4:junit4] 2> 23041 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 23041 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 23042 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440003 closed
[junit4:junit4] 2> 23041 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 23042 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49520 which had sessionid 0x13d52b36a440003
[junit4:junit4] 2> 23043 T1133 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 23043 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 23044 T1149 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 23044 T1117 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 23045 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:delete cxid:0xbc zxid:0xce txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 23045 T1117 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 23047 T1117 oasc.Overseer.start Overseer (id=89318498152742918-127.0.0.1:49616__v-n_0000000001) starting
[junit4:junit4] 2> 23047 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0xc1 zxid:0xd0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23048 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0xc2 zxid:0xd1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23048 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0xc3 zxid:0xd2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23049 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440006 type:create cxid:0xc4 zxid:0xd3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23049 T1160 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 23050 T1159 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 23051 T1159 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23051 T1159 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54828/_v",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:54828__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 23063 T1075 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_v,null}
[junit4:junit4] 2> 23114 T1075 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49616
[junit4:junit4] 2> 23114 T1075 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=9810073
[junit4:junit4] 2> 23319 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 23319 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 23319 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 24342 T1097 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 24342 T1097 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 24342 T1097 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 24825 T1159 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24826 T1159 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 24830 T1159 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49616__v_onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 24833 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 24833 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 24833 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 26322 T1075 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 26323 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 26325 T1075 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 26327 T1075 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@13bf15c
[junit4:junit4] 2> 26329 T1075 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 26329 T1075 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 26330 T1075 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 26330 T1075 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 26331 T1075 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 26332 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/index
[junit4:junit4] 2> 26332 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1/index
[junit4:junit4] 2> 26332 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1
[junit4:junit4] 2> 26333 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty1
[junit4:junit4] 2> 26333 T1075 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@1d47c4b
[junit4:junit4] 2> 26336 T1075 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 26337 T1075 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 26337 T1075 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 26337 T1075 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 26338 T1075 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 26338 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/index
[junit4:junit4] 2> 26339 T1159 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26339 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection/index
[junit4:junit4] 2> 26339 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection
[junit4:junit4] 2> 26339 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362892122680/onenodecollection
[junit4:junit4] 2> 26339 T1159 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 26340 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440006
[junit4:junit4] 2> 26341 T1117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 26341 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 26341 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49523 which had sessionid 0x13d52b36a440006
[junit4:junit4] 2> 26341 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440006 closed
[junit4:junit4] 2> 26342 T1133 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 26342 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26342 T1149 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 26343 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:delete cxid:0x58 zxid:0xe4 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 26343 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:delete cxid:0x74 zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 26344 T1149 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 26344 T1133 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 26344 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x59 zxid:0xe6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26345 T1149 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 26345 T1149 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 26345 T1149 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 26345 T1149 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59118/_v/collection1/
[junit4:junit4] 2> 26345 T1133 oasc.Overseer.start Overseer (id=89318498152742920-127.0.0.1:57006__v-n_0000000002) starting
[junit4:junit4] 2> 26345 T1149 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 26346 T1149 oasc.SyncStrategy.syncToMe http://127.0.0.1:59118/_v/collection1/ has no replicas
[junit4:junit4] 2> 26346 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x79 zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26346 T1149 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59118/_v/collection1/
[junit4:junit4] 2> 26346 T1149 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 26346 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x7a zxid:0xea txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26347 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x7b zxid:0xeb txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26347 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a440008 type:create cxid:0x7c zxid:0xec txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26350 T1162 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 26352 T1161 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 26352 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x61 zxid:0xee txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26354 T1161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26355 T1161 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 26357 T1161 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 26362 T1075 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_v,null}
[junit4:junit4] 2> 26392 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26392 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26414 T1075 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57006
[junit4:junit4] 2> 26415 T1075 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=8309423
[junit4:junit4] 2> 27417 T1075 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 27417 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 27420 T1075 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@d1fdb9
[junit4:junit4] 2> 27424 T1075 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 27424 T1075 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 27425 T1075 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 27425 T1075 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 27426 T1075 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 27426 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/index
[junit4:junit4] 2> 27427 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2/index
[junit4:junit4] 2> 27427 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2
[junit4:junit4] 2> 27428 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty2
[junit4:junit4] 2> 27429 T1161 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318498152742920-127.0.0.1:57006__v-n_0000000002) am no longer a leader.
[junit4:junit4] 2> 27429 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a440008
[junit4:junit4] 2> 27430 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 27430 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49528 which had sessionid 0x13d52b36a440008
[junit4:junit4] 2> 27430 T1133 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27430 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a440008 closed
[junit4:junit4] 2> 27430 T1133 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 27431 T1133 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27431 T1133 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 27432 T1149 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 27432 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:delete cxid:0x69 zxid:0x100 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 27433 T1149 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 27435 T1149 oasc.Overseer.start Overseer (id=89318498152742922-127.0.0.1:59118__v-n_0000000003) starting
[junit4:junit4] 2> 27435 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x6e zxid:0x102 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27436 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x6f zxid:0x103 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27437 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x70 zxid:0x104 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27438 T1080 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d52b36a44000a type:create cxid:0x71 zxid:0x105 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 27439 T1164 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 27440 T1163 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 27441 T1163 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27442 T1163 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57006/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:57006__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 27445 T1163 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57006/_v",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:57006__v",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 27451 T1075 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_v,null}
[junit4:junit4] 2> 27452 T1149 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 27504 T1075 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 59118
[junit4:junit4] 2> 27504 T1075 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=24900277
[junit4:junit4] 2> 27641 T1117 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27642 T1117 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27642 T1117 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 28506 T1075 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 28507 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 28509 T1075 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@c68fa0
[junit4:junit4] 2> 28513 T1075 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28514 T1075 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28514 T1075 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28514 T1075 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28516 T1075 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 28516 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3
[junit4:junit4] 2> 28516 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3
[junit4:junit4] 2> 28517 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index.20130310060902174
[junit4:junit4] 2> 28517 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index.20130310060902174
[junit4:junit4] 2> 28517 T1075 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index
[junit4:junit4] 2> 28517 T1075 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362892122680/jetty3/index
[junit4:junit4] 2> 28518 T1163 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89318498152742922-127.0.0.1:59118__v-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 28519 T1080 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d52b36a44000a
[junit4:junit4] 2> 28519 T1077 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49533 which had sessionid 0x13d52b36a44000a
[junit4:junit4] 2> 28519 T1075 oaz.ZooKeeper.close Session: 0x13d52b36a44000a closed
[junit4:junit4] 2> 28540 T1075 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_v,null}
[junit4:junit4] 2> 28595 T1075 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 28595 T1075 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 28595 T1075 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 28596 T1075 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28596 T1080 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4] 2> 28596 T1075 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28597 T1079 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4] 2> 28597 T1075 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 28598 T1075 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:54651 54651
[junit4:junit4] 2> 28599 T1077 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 28600 T1075 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 28600 T1075 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 28600 T1075 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28600 T1075 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 28601 T1075 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> / (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr (7)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "shards":{
[junit4:junit4] 1> "shard2":{
[junit4:junit4] 1> "range":"0-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "2":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "4":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:59118/_v",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:59118__v",
[junit4:junit4] 1> "state":"active"}}},
[junit4:junit4] 1> "shard1":{
[junit4:junit4] 1> "range":"80000000-ffffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"3":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57006/_v",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:57006__v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:54828/_v",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:54828__v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "onenodecollection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:49616__v_onenodecollectioncore":{
[junit4:junit4] 1> "roles":"none",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49616/_v",
[junit4:junit4] 1> "collection":"onenodecollection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "node_name":"127.0.0.1:49616__v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/configs (1)
[junit4:junit4] 1> /solr/configs/conf1 (9)
[junit4:junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4] 1> "timestamp": 1332070464,
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "base": "USD",
[junit4:junit4] 1> "rates": {
[junit4:junit4] 1> "USD": 1,
[junit4:junit4] 1> "JPY": 81.29,
[junit4:junit4] 1> "EUR": 2.5,
[junit4:junit4] 1> "GBP": 0.5,
[junit4:junit4] 1> "MXN": 2.0
[junit4:junit4] 1> }
[junit4:junit4] 1> }
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/collections (3)
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:54828/_v",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:54828__v"}
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89318498152742915-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/leaders (2)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4]
[...truncated too long message...]
859-1
[junit4:junit4] FAILURE 137s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F8D6F0A4F3887AE4:79307EBC84D71AD8]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 136739 T1806 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 136754 T1805 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 137336 T1809 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 137838 T1888 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 137838 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 137838 T1888 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 137839 T1888 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {other_tl1=Lucene41(blocksize=128), intDefault=Lucene41(blocksize=128), id=PostingsFormat(name=Lucene41WithOrds), range_facet_l=PostingsFormat(name=Memory doPackFST= true), timestamp=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=Memory doPackFST= true), _version_=Lucene41(blocksize=128), multiDefault=PostingsFormat(name=Memory doPackFST= true), a_si=Lucene41(blocksize=128), text=PostingsFormat(name=Asserting), range_facet_sl=PostingsFormat(name=Lucene41WithOrds), a_t=PostingsFormat(name=Memory doPackFST= true)}, docValues:{timestamp=DocValuesFormat(name=Disk)}, sim=DefaultSimilarity, locale=es_EC, timezone=Europe/Tirane
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=73187208,total=177606656
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJmxIntegration, TestIndexingPerformance, StatsComponentTest, CopyFieldTest, XsltUpdateRequestHandlerTest, RequestHandlersTest, TestUtils, HighlighterTest, TestSystemIdResolver, TestPropInject, TestRangeQuery, TestCodecSupport, TestLMJelinekMercerSimilarityFactory, TestLuceneMatchVersion, DirectUpdateHandlerTest, TestOmitPositions, XmlUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestStressReorder, TestPostingsSolrHighlighter, TestFiltering, SolrIndexConfigTest, StandardRequestHandlerTest, FileUtilsTest, TestLazyCores, TestCollationField, TestDefaultSimilarityFactory, CurrencyFieldOpenExchangeTest, SolrCmdDistributorTest, CoreContainerCoreInitFailuresTest, ClusterStateTest, TestCopyFieldCollectionResource, TestMultiCoreConfBootstrap, TestBinaryField, ChaosMonkeySafeLeaderTest, DefaultValueUpdateProcessorTest, TestElisionMultitermQuery, OutputWriterTest, FieldAnalysisRequestHandlerTest, PingRequestHandlerTest, TestSolrXMLSerializer, TermVectorComponentDistributedTest, JSONWriterTest, URLClassifyProcessorTest, FullSolrCloudDistribCmdsTest, TestIndexSearcher, BasicDistributedZk2Test, TestReload, SolrRequestParserTest, TestDistributedSearch, EchoParamsTest, NumericFieldsTest, TestHashPartitioner, TestRandomFaceting, SolrPluginUtilsTest, IndexBasedSpellCheckerTest, DOMUtilTest, TestCSVLoader, TestPartialUpdateDeduplication, TestZkChroot, DisMaxRequestHandlerTest, TestDistributedGrouping, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 138.03s, 1 test, 1 failure <<< FAILURES!
[...truncated 422 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:877: There were test failures: 269 suites, 1137 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 46 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure