You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/04 06:29:27 UTC

[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4532 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4532/
Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:38088/u/onenodecollectioncore returned non ok status:404, message:Can not find: /u/onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:38088/u/onenodecollectioncore returned non ok status:404, message:Can not find: /u/onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([46D2BCF0926546AF:C73432E8E53A2693]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard

Stack Trace:
java.lang.AssertionError: Still found shard
	at __randomizedtesting.SeedInfo.seed([46D2BCF0926546AF:C73432E8E53A2693]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9615 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 0 T1882 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /u/
[junit4:junit4]   2> 2 T1882 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574
[junit4:junit4]   2> 3 T1882 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 4 T1883 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 5 T1883 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 5 T1883 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 5 T1883 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 6 T1883 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 7 T1883 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 104 T1882 oasc.ZkTestServer.run start zk server on port:41412
[junit4:junit4]   2> 104 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16260a7
[junit4:junit4]   2> 106 T1888 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 105 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 106 T1888 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 106 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55667
[junit4:junit4]   2> 107 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55667
[junit4:junit4]   2> 107 T1886 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 111 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0000 with negotiated timeout 10000 for client /127.0.0.1:55667
[junit4:junit4]   2> 111 T1888 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0000, negotiated timeout = 10000
[junit4:junit4]   2> 112 T1889 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16260a7 name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 112 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 113 T1882 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 117 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0000
[junit4:junit4]   2> 119 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55667 which had sessionid 0x13d33dbf38b0000
[junit4:junit4]   2> 118 T1889 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 118 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0000 closed
[junit4:junit4]   2> 120 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a5977b
[junit4:junit4]   2> 121 T1890 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 121 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 122 T1890 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 122 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55668
[junit4:junit4]   2> 122 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55668
[junit4:junit4]   2> 123 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0001 with negotiated timeout 10000 for client /127.0.0.1:55668
[junit4:junit4]   2> 123 T1890 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0001, negotiated timeout = 10000
[junit4:junit4]   2> 124 T1891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a5977b name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 124 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 125 T1882 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 130 T1882 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 134 T1882 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 138 T1882 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 141 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 142 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 149 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 150 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 155 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 155 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 159 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 160 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 164 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 165 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 169 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 170 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 174 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 175 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 180 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 180 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 185 T1882 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 185 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 189 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0001
[junit4:junit4]   2> 190 T1891 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 190 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55668 which had sessionid 0x13d33dbf38b0001
[junit4:junit4]   2> 190 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0001 closed
[junit4:junit4]   2> 259 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 267 T1882 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34619
[junit4:junit4]   2> 268 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 268 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 268 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762
[junit4:junit4]   2> 269 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/solr.xml
[junit4:junit4]   2> 269 T1882 oasc.CoreContainer.<init> New CoreContainer 25675500
[junit4:junit4]   2> 269 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/'
[junit4:junit4]   2> 269 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/'
[junit4:junit4]   2> 283 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 284 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 284 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 284 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 285 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 285 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 285 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 286 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 286 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 286 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 292 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 301 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:41412/solr
[junit4:junit4]   2> 301 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 301 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b37fb5
[junit4:junit4]   2> 302 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 302 T1901 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 303 T1901 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 303 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55669
[junit4:junit4]   2> 303 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55669
[junit4:junit4]   2> 304 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0002 with negotiated timeout 20000 for client /127.0.0.1:55669
[junit4:junit4]   2> 304 T1901 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0002, negotiated timeout = 20000
[junit4:junit4]   2> 305 T1902 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b37fb5 name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 305 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 306 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0002
[junit4:junit4]   2> 307 T1902 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 307 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55669 which had sessionid 0x13d33dbf38b0002
[junit4:junit4]   2> 307 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0002 closed
[junit4:junit4]   2> 308 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 310 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@11d5b4b
[junit4:junit4]   2> 325 T1903 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 311 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 326 T1903 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 326 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55670
[junit4:junit4]   2> 326 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55670
[junit4:junit4]   2> 329 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0003 with negotiated timeout 20000 for client /127.0.0.1:55670
[junit4:junit4]   2> 329 T1903 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0003, negotiated timeout = 20000
[junit4:junit4]   2> 329 T1904 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11d5b4b name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 329 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 331 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 334 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 337 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34619_u
[junit4:junit4]   2> 338 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34619_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34619_u
[junit4:junit4]   2> 339 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34619_u
[junit4:junit4]   2> 343 T1882 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 350 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 351 T1882 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 355 T1882 oasc.Overseer.start Overseer (id=89284587394105347-127.0.0.1:34619_u-n_0000000000) starting
[junit4:junit4]   2> 356 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 357 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 358 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 360 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 361 T1906 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 362 T1882 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 367 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 370 T1905 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 374 T1907 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/collection1
[junit4:junit4]   2> 374 T1907 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 375 T1907 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 375 T1907 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 377 T1907 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/collection1/'
[junit4:junit4]   2> 378 T1907 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/collection1/lib/README' to classloader
[junit4:junit4]   2> 379 T1907 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 421 T1907 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 445 T1907 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 446 T1907 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 450 T1907 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 752 T1907 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 758 T1907 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 760 T1907 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 770 T1907 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 773 T1907 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 775 T1907 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 776 T1907 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 776 T1907 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 776 T1907 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 777 T1907 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 777 T1907 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 777 T1907 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362374685762/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data/
[junit4:junit4]   2> 777 T1907 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1adeb57
[junit4:junit4]   2> 778 T1907 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 784 T1907 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data forceNew:false
[junit4:junit4]   2> 784 T1907 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data
[junit4:junit4]   2> 784 T1907 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data/index/
[junit4:junit4]   2> 784 T1907 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 784 T1907 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data/index forceNew:false
[junit4:junit4]   2> 787 T1907 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@191c609; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 788 T1907 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 788 T1907 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data/index
[junit4:junit4]   2> 789 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 789 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 790 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 790 T1907 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 790 T1907 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 790 T1907 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 790 T1907 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 791 T1907 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 791 T1907 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 793 T1907 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 802 T1907 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/control/data
[junit4:junit4]   2> 803 T1907 oass.SolrIndexSearcher.<init> Opening Searcher@40e862 main
[junit4:junit4]   2> 803 T1907 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 803 T1907 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 806 T1908 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40e862 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 807 T1907 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 807 T1907 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 807 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1875 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1876 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34619/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34619_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1"}
[junit4:junit4]   2> 1876 T1905 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 1877 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1877 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1884 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2809 T1907 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2810 T1907 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34619/u collection:control_collection shard:shard1
[junit4:junit4]   2> 2811 T1907 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2820 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2821 T1907 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2821 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2825 T1907 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2826 T1907 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2826 T1907 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34619/u/collection1/
[junit4:junit4]   2> 2826 T1907 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2826 T1907 oasc.SyncStrategy.syncToMe http://127.0.0.1:34619/u/collection1/ has no replicas
[junit4:junit4]   2> 2827 T1907 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34619/u/collection1/
[junit4:junit4]   2> 2827 T1907 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2834 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3390 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3401 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3439 T1907 oasc.ZkController.register We are http://127.0.0.1:34619/u/collection1/ and leader is http://127.0.0.1:34619/u/collection1/
[junit4:junit4]   2> 3440 T1907 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34619/u
[junit4:junit4]   2> 3440 T1907 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3440 T1907 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3440 T1907 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3442 T1907 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3444 T1882 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3445 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3445 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3452 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3453 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@83b8e5
[junit4:junit4]   2> 3454 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3455 T1909 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3455 T1909 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 3456 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55674
[junit4:junit4]   2> 3456 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55674
[junit4:junit4]   2> 3457 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0004 with negotiated timeout 10000 for client /127.0.0.1:55674
[junit4:junit4]   2> 3457 T1909 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0004, negotiated timeout = 10000
[junit4:junit4]   2> 3458 T1910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@83b8e5 name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3458 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3459 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3462 T1882 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3525 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3527 T1882 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54423
[junit4:junit4]   2> 3528 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3528 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3529 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034
[junit4:junit4]   2> 3529 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/solr.xml
[junit4:junit4]   2> 3529 T1882 oasc.CoreContainer.<init> New CoreContainer 24957272
[junit4:junit4]   2> 3530 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/'
[junit4:junit4]   2> 3530 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/'
[junit4:junit4]   2> 3544 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3544 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3545 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3545 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3545 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3545 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3546 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3546 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3546 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3547 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3552 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3560 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:41412/solr
[junit4:junit4]   2> 3560 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3560 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7aabd5
[junit4:junit4]   2> 3561 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3561 T1920 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3562 T1920 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 3562 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55675
[junit4:junit4]   2> 3563 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55675
[junit4:junit4]   2> 3564 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0005 with negotiated timeout 20000 for client /127.0.0.1:55675
[junit4:junit4]   2> 3564 T1920 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0005, negotiated timeout = 20000
[junit4:junit4]   2> 3564 T1921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aabd5 name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3564 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3566 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0005
[junit4:junit4]   2> 3566 T1921 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3566 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55675 which had sessionid 0x13d33dbf38b0005
[junit4:junit4]   2> 3566 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0005 closed
[junit4:junit4]   2> 3567 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3570 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f199db
[junit4:junit4]   2> 3570 T1922 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3570 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3571 T1922 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 3571 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55676
[junit4:junit4]   2> 3571 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55676
[junit4:junit4]   2> 3572 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0006 with negotiated timeout 20000 for client /127.0.0.1:55676
[junit4:junit4]   2> 3572 T1922 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0006, negotiated timeout = 20000
[junit4:junit4]   2> 3573 T1923 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f199db name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3573 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3574 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3575 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3576 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4579 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54423_u
[junit4:junit4]   2> 4581 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:delete cxid:0x9 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54423_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54423_u
[junit4:junit4]   2> 4582 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54423_u
[junit4:junit4]   2> 4585 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4586 T1910 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4586 T1923 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4588 T1904 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4596 T1924 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/collection1
[junit4:junit4]   2> 4596 T1924 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4597 T1924 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4597 T1924 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4599 T1924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/collection1/'
[junit4:junit4]   2> 4599 T1924 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/collection1/lib/README' to classloader
[junit4:junit4]   2> 4600 T1924 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4641 T1924 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 4685 T1924 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4686 T1924 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4692 T1924 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4908 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4908 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34619/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34619_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1"}
[junit4:junit4]   2> 4911 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4911 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4923 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5047 T1924 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5052 T1924 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5054 T1924 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5069 T1924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5074 T1924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5079 T1924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5080 T1924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5081 T1924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5081 T1924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5082 T1924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5083 T1924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5083 T1924 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/
[junit4:junit4]   2> 5083 T1924 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1adeb57
[junit4:junit4]   2> 5084 T1924 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5085 T1924 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1 forceNew:false
[junit4:junit4]   2> 5085 T1924 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1
[junit4:junit4]   2> 5085 T1924 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index/
[junit4:junit4]   2> 5086 T1924 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5086 T1924 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index forceNew:false
[junit4:junit4]   2> 5091 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13b1092; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5092 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5092 T1924 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index
[junit4:junit4]   2> 5095 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5095 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5096 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5097 T1924 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5098 T1924 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5098 T1924 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5098 T1924 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5099 T1924 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5099 T1924 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5104 T1924 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5106 T1924 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1
[junit4:junit4]   2> 5106 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@63d7e4 main
[junit4:junit4]   2> 5107 T1924 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5107 T1924 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5113 T1925 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63d7e4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5116 T1924 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5116 T1924 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6428 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6430 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54423/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54423_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2"}
[junit4:junit4]   2> 6430 T1905 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 6430 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 6436 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6436 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6436 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7118 T1924 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7118 T1924 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54423/u collection:collection1 shard:shard2
[junit4:junit4]   2> 7119 T1924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 7129 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:delete cxid:0x46 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7129 T1924 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7130 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:create cxid:0x47 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7133 T1924 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7133 T1924 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7133 T1924 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54423/u/collection1/
[junit4:junit4]   2> 7133 T1924 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7134 T1924 oasc.SyncStrategy.syncToMe http://127.0.0.1:54423/u/collection1/ has no replicas
[junit4:junit4]   2> 7134 T1924 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54423/u/collection1/
[junit4:junit4]   2> 7134 T1924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 7140 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:create cxid:0x51 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7942 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7954 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7954 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7954 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7995 T1924 oasc.ZkController.register We are http://127.0.0.1:54423/u/collection1/ and leader is http://127.0.0.1:54423/u/collection1/
[junit4:junit4]   2> 7995 T1924 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54423/u
[junit4:junit4]   2> 7995 T1924 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7996 T1924 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 7996 T1924 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7998 T1924 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7999 T1882 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8000 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8001 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8066 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8069 T1882 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38088
[junit4:junit4]   2> 8070 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8071 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8071 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578
[junit4:junit4]   2> 8071 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/solr.xml
[junit4:junit4]   2> 8071 T1882 oasc.CoreContainer.<init> New CoreContainer 29281836
[junit4:junit4]   2> 8072 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/'
[junit4:junit4]   2> 8073 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/'
[junit4:junit4]   2> 8090 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8090 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8091 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8091 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8091 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8092 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8092 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8092 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8092 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8093 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8098 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8106 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:41412/solr
[junit4:junit4]   2> 8106 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8106 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@c59bdc
[junit4:junit4]   2> 8107 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8107 T1935 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8108 T1935 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 8108 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55680
[junit4:junit4]   2> 8108 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55680
[junit4:junit4]   2> 8109 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0007 with negotiated timeout 20000 for client /127.0.0.1:55680
[junit4:junit4]   2> 8109 T1935 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0007, negotiated timeout = 20000
[junit4:junit4]   2> 8110 T1936 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c59bdc name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8110 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8111 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0007
[junit4:junit4]   2> 8112 T1936 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8112 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55680 which had sessionid 0x13d33dbf38b0007
[junit4:junit4]   2> 8112 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0007 closed
[junit4:junit4]   2> 8113 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8115 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e180f4
[junit4:junit4]   2> 8116 T1937 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8116 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8116 T1937 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 8117 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55681
[junit4:junit4]   2> 8117 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55681
[junit4:junit4]   2> 8119 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0008 with negotiated timeout 20000 for client /127.0.0.1:55681
[junit4:junit4]   2> 8119 T1937 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0008, negotiated timeout = 20000
[junit4:junit4]   2> 8119 T1938 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e180f4 name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8120 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8121 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8122 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8123 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9127 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38088_u
[junit4:junit4]   2> 9129 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38088_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38088_u
[junit4:junit4]   2> 9130 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38088_u
[junit4:junit4]   2> 9132 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9133 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9133 T1910 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9133 T1938 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9133 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9134 T1904 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9135 T1923 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9141 T1939 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/collection1
[junit4:junit4]   2> 9141 T1939 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9142 T1939 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9142 T1939 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9144 T1939 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/collection1/'
[junit4:junit4]   2> 9145 T1939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/collection1/lib/README' to classloader
[junit4:junit4]   2> 9145 T1939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9202 T1939 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 9226 T1939 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9228 T1939 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9231 T1939 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9461 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9462 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54423/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54423_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2"}
[junit4:junit4]   2> 9465 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9465 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9465 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9465 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9562 T1939 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9567 T1939 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9569 T1939 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9585 T1939 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9588 T1939 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9592 T1939 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9593 T1939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9593 T1939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9594 T1939 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9595 T1939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9596 T1939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9596 T1939 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362374693578/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/
[junit4:junit4]   2> 9596 T1939 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1adeb57
[junit4:junit4]   2> 9597 T1939 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 9597 T1939 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2 forceNew:false
[junit4:junit4]   2> 9597 T1939 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2
[junit4:junit4]   2> 9598 T1939 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index/
[junit4:junit4]   2> 9598 T1939 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9598 T1939 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index forceNew:false
[junit4:junit4]   2> 9603 T1939 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1233e18; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9603 T1939 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9604 T1939 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index
[junit4:junit4]   2> 9606 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9607 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9608 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9608 T1939 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9609 T1939 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9609 T1939 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9610 T1939 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9611 T1939 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9611 T1939 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9616 T1939 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9620 T1939 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2
[junit4:junit4]   2> 9621 T1939 oass.SolrIndexSearcher.<init> Opening Searcher@1159851 main
[junit4:junit4]   2> 9621 T1939 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9622 T1939 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9628 T1940 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1159851 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9630 T1939 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9631 T1939 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10971 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10972 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38088/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38088_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3"}
[junit4:junit4]   2> 10972 T1905 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 10972 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 10979 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10979 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10979 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10979 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11633 T1939 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11633 T1939 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38088/u collection:collection1 shard:shard1
[junit4:junit4]   2> 11634 T1939 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11643 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0008 type:delete cxid:0x45 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 11645 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 11645 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0008 type:create cxid:0x46 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11649 T1939 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11649 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11649 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38088/u/collection1/
[junit4:junit4]   2> 11650 T1939 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 11650 T1939 oasc.SyncStrategy.syncToMe http://127.0.0.1:38088/u/collection1/ has no replicas
[junit4:junit4]   2> 11650 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38088/u/collection1/
[junit4:junit4]   2> 11650 T1939 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 11655 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0008 type:create cxid:0x4f zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12486 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12499 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12499 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12499 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12499 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12510 T1939 oasc.ZkController.register We are http://127.0.0.1:38088/u/collection1/ and leader is http://127.0.0.1:38088/u/collection1/
[junit4:junit4]   2> 12511 T1939 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38088/u
[junit4:junit4]   2> 12511 T1939 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 12511 T1939 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12511 T1939 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12514 T1939 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12515 T1882 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 12516 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12516 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12583 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12585 T1882 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47539
[junit4:junit4]   2> 12586 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12586 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12587 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094
[junit4:junit4]   2> 12587 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/solr.xml
[junit4:junit4]   2> 12587 T1882 oasc.CoreContainer.<init> New CoreContainer 24760857
[junit4:junit4]   2> 12588 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/'
[junit4:junit4]   2> 12588 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/'
[junit4:junit4]   2> 12622 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12623 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12623 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12624 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12624 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12625 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12625 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12626 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12626 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12627 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12637 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12646 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:41412/solr
[junit4:junit4]   2> 12646 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12646 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e5874c
[junit4:junit4]   2> 12647 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12647 T1950 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12648 T1950 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 12648 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55685
[junit4:junit4]   2> 12648 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55685
[junit4:junit4]   2> 12649 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b0009 with negotiated timeout 20000 for client /127.0.0.1:55685
[junit4:junit4]   2> 12649 T1950 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b0009, negotiated timeout = 20000
[junit4:junit4]   2> 12649 T1951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e5874c name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12650 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12651 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0009
[junit4:junit4]   2> 12652 T1951 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12652 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55685 which had sessionid 0x13d33dbf38b0009
[junit4:junit4]   2> 12652 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0009 closed
[junit4:junit4]   2> 12652 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 12655 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1aeb82
[junit4:junit4]   2> 12655 T1952 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12655 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12656 T1952 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 12656 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55686
[junit4:junit4]   2> 12656 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55686
[junit4:junit4]   2> 12657 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b000a with negotiated timeout 20000 for client /127.0.0.1:55686
[junit4:junit4]   2> 12657 T1952 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b000a, negotiated timeout = 20000
[junit4:junit4]   2> 12657 T1953 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aeb82 name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12658 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12659 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12659 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12661 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13664 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47539_u
[junit4:junit4]   2> 13665 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b000a type:delete cxid:0x9 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47539_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47539_u
[junit4:junit4]   2> 13666 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47539_u
[junit4:junit4]   2> 13670 T1953 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13670 T1910 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13670 T1904 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13671 T1938 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13671 T1923 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13672 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13671 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13671 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13671 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13681 T1954 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/collection1
[junit4:junit4]   2> 13681 T1954 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 13682 T1954 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 13682 T1954 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 13684 T1954 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/collection1/'
[junit4:junit4]   2> 13685 T1954 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/collection1/lib/README' to classloader
[junit4:junit4]   2> 13685 T1954 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 13714 T1954 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 13738 T1954 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13739 T1954 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13759 T1954 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14007 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14008 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38088/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38088_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3"}
[junit4:junit4]   2> 14012 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14012 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14012 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14012 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14012 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14098 T1954 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14103 T1954 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14105 T1954 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14120 T1954 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14123 T1954 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14126 T1954 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14127 T1954 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14127 T1954 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14128 T1954 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14129 T1954 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14129 T1954 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14129 T1954 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362374698094/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/
[junit4:junit4]   2> 14130 T1954 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1adeb57
[junit4:junit4]   2> 14130 T1954 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 14131 T1954 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3 forceNew:false
[junit4:junit4]   2> 14131 T1954 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 14131 T1954 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index/
[junit4:junit4]   2> 14132 T1954 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14132 T1954 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index forceNew:false
[junit4:junit4]   2> 14136 T1954 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5de590; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14137 T1954 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14137 T1954 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index
[junit4:junit4]   2> 14140 T1954 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14140 T1954 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14141 T1954 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14142 T1954 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14142 T1954 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14143 T1954 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14143 T1954 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14144 T1954 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14144 T1954 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14149 T1954 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14152 T1954 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 14153 T1954 oass.SolrIndexSearcher.<init> Opening Searcher@125a4af main
[junit4:junit4]   2> 14154 T1954 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14155 T1954 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14161 T1955 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@125a4af main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14163 T1954 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14164 T1954 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15516 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15517 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47539/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47539_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4"}
[junit4:junit4]   2> 15517 T1905 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 15517 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 15521 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15521 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15521 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15521 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15521 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16166 T1954 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16166 T1954 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47539/u collection:collection1 shard:shard2
[junit4:junit4]   2> 16171 T1954 oasc.ZkController.register We are http://127.0.0.1:47539/u/collection1/ and leader is http://127.0.0.1:54423/u/collection1/
[junit4:junit4]   2> 16171 T1954 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47539/u
[junit4:junit4]   2> 16172 T1954 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16172 T1954 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C93 name=collection1 org.apache.solr.core.SolrCore@87b794 url=http://127.0.0.1:47539/u/collection1 node=127.0.0.1:47539_u C93_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:47539/u, node_name=127.0.0.1:47539_u, core=collection1, state=down}
[junit4:junit4]   2> 16173 T1956 C93 P47539 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16174 T1954 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16175 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16175 T1956 C93 P47539 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16175 T1956 C93 P47539 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16176 T1882 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 16177 T1956 C93 P47539 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16177 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16177 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16233 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 16235 T1882 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55192
[junit4:junit4]   2> 16236 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 16236 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16237 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752
[junit4:junit4]   2> 16237 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/solr.xml
[junit4:junit4]   2> 16237 T1882 oasc.CoreContainer.<init> New CoreContainer 10346238
[junit4:junit4]   2> 16238 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/'
[junit4:junit4]   2> 16238 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/'
[junit4:junit4]   2> 16252 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 16252 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 16252 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 16253 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 16253 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 16253 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 16254 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 16254 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 16254 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 16254 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 16260 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 16268 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:41412/solr
[junit4:junit4]   2> 16268 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 16269 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1193397
[junit4:junit4]   2> 16270 T1966 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16269 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16270 T1966 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 16270 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55692
[junit4:junit4]   2> 16271 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55692
[junit4:junit4]   2> 16272 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b000b with negotiated timeout 20000 for client /127.0.0.1:55692
[junit4:junit4]   2> 16272 T1966 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b000b, negotiated timeout = 20000
[junit4:junit4]   2> 16272 T1967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1193397 name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16272 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16273 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b000b
[junit4:junit4]   2> 16274 T1967 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16274 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55692 which had sessionid 0x13d33dbf38b000b
[junit4:junit4]   2> 16274 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b000b closed
[junit4:junit4]   2> 16275 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 16277 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@43fa08
[junit4:junit4]   2> 16278 T1968 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16278 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16278 T1968 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 16278 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55693
[junit4:junit4]   2> 16279 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55693
[junit4:junit4]   2> 16279 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b000c with negotiated timeout 20000 for client /127.0.0.1:55693
[junit4:junit4]   2> 16279 T1968 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b000c, negotiated timeout = 20000
[junit4:junit4]   2> 16280 T1969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43fa08 name:ZooKeeperConnection Watcher:127.0.0.1:41412/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16280 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16281 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b000c type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16282 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b000c type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16283 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 17025 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17025 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47539/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47539_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4"}
[junit4:junit4]   2> 17029 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17029 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17029 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17029 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17029 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17029 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17286 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55192_u
[junit4:junit4]   2> 17287 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b000c type:delete cxid:0xb zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55192_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55192_u
[junit4:junit4]   2> 17289 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55192_u
[junit4:junit4]   2> 17292 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17292 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17293 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17293 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17293 T1910 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17293 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17294 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17295 T1923 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17295 T1938 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17296 T1904 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17296 T1953 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17297 T1969 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17304 T1970 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/collection1
[junit4:junit4]   2> 17305 T1970 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 17306 T1970 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 17306 T1970 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 17308 T1970 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/collection1/'
[junit4:junit4]   2> 17308 T1970 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/collection1/lib/README' to classloader
[junit4:junit4]   2> 17309 T1970 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 17335 T1970 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 17387 T1970 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17388 T1970 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17392 T1970 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17738 T1970 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17743 T1970 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17745 T1970 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17760 T1970 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17764 T1970 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17768 T1970 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17770 T1970 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17770 T1970 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17770 T1970 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17772 T1970 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17772 T1970 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17772 T1970 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362374701752/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/
[junit4:junit4]   2> 17773 T1970 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1adeb57
[junit4:junit4]   2> 17773 T1970 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 17774 T1970 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4 forceNew:false
[junit4:junit4]   2> 17774 T1970 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 17774 T1970 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index/
[junit4:junit4]   2> 17775 T1970 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17775 T1970 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index forceNew:false
[junit4:junit4]   2> 17779 T1970 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2bd3c7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17780 T1970 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17781 T1970 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index
[junit4:junit4]   2> 17783 T1970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17784 T1970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17785 T1970 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17785 T1970 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17786 T1970 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17786 T1970 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17787 T1970 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17788 T1970 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17788 T1970 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17792 T1970 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17796 T1970 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 17797 T1970 oass.SolrIndexSearcher.<init> Opening Searcher@1e75b60 main
[junit4:junit4]   2> 17798 T1970 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17799 T1970 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17804 T1971 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e75b60 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17806 T1970 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17807 T1970 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18534 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18535 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55192/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55192_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5"}
[junit4:junit4]   2> 18535 T1905 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 18535 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 18541 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18542 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18542 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18542 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18542 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18542 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18808 T1970 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18808 T1970 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55192/u collection:collection1 shard:shard1
[junit4:junit4]   2> 18813 T1970 oasc.ZkController.register We are http://127.0.0.1:55192/u/collection1/ and leader is http://127.0.0.1:38088/u/collection1/
[junit4:junit4]   2> 18813 T1970 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55192/u
[junit4:junit4]   2> 18814 T1970 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 18814 T1970 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C94 name=collection1 org.apache.solr.core.SolrCore@196c6e6 url=http://127.0.0.1:55192/u/collection1 node=127.0.0.1:55192_u C94_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:55192/u, node_name=127.0.0.1:55192_u, core=collection1, state=down}
[junit4:junit4]   2> 18815 T1972 C94 P55192 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 18816 T1970 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18816 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 18817 T1972 C94 P55192 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 18817 T1972 C94 P55192 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18818 T1882 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4]   2> 18819 T1972 C94 P55192 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18819 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 18819 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18826 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18828 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18837 T1916 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/onenodecollectioncore
[junit4:junit4]   2> 18837 T1916 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 18838 T1916 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 18839 T1916 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 18841 T1916 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 18841 T1916 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 18865 T1916 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 18867 T1916 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/onenodecollectioncore/'
[junit4:junit4]   2> 18915 T1916 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 18969 T1916 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 18970 T1916 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 18974 T1916 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2>  C93_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:47539/u, node_name=127.0.0.1:47539_u, core=collection1, state=recovering, shard=shard2}
[junit4:junit4]   2> 19184 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54423/u/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 19185 T1956 C93 P47539 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47539/u START replicas=[http://127.0.0.1:54423/u/collection1/] nUpdates=100
[junit4:junit4]   2> 19185 T1956 C93 P47539 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19185 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 19186 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 19186 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 19186 T1956 C93 P47539 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19186 T1956 C93 P47539 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54423/u/collection1/. core=collection1
[junit4:junit4]   2> 19186 T1956 C93 P47539 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C95 name=collection1 org.apache.solr.core.SolrCore@11e2806 url=http://127.0.0.1:54423/u/collection1 node=127.0.0.1:54423_u C95_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:54423/u, node_name=127.0.0.1:54423_u, core=collection1, state=active, shard=shard2, leader=true}
[junit4:junit4]   2> 19191 T1919 C95 P54423 REQ /get {getVersions=100&version=2&wt=javabin&qt=/get&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 19193 T1917 C95 P54423 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19194 T1917 C95 P54423 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1
[junit4:junit4]   2> 19197 T1917 C95 P54423 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13b1092; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19198 T1917 C95 P54423 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19204 T1917 C95 P54423 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13b1092; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13b1092; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19204 T1917 C95 P54423 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19205 T1917 C95 P54423 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1
[junit4:junit4]   2> 19205 T1917 C95 P54423 oass.SolrIndexSearcher.<init> Opening Searcher@188c27f realtime
[junit4:junit4]   2> 19205 T1917 C95 P54423 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19206 T1917 C95 P54423 /update {version=2&softCommit=false&wt=javabin&openSearcher=false&commit_end_point=true&waitSearcher=true&commit=true} {commit=} 0 13
[junit4:junit4]   2> 19207 T1956 C93 P47539 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19207 T1956 C93 P47539 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19213 T1918 C95 P54423 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19213 T1918 C95 P54423 REQ /replication {command=indexversion&version=2&wt=javabin&qt=/replication} status=0 QTime=4 
[junit4:junit4]   2> 19214 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 19214 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19214 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19217 T1917 C95 P54423 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1
[junit4:junit4]   2> 19217 T1917 C95 P54423 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty1/index
[junit4:junit4]   2> 19218 T1917 C95 P54423 REQ /replication {command=filelist&version=2&wt=javabin&generation=2&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 19218 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19219 T1956 C93 P47539 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index.20130304012504790 forceNew:false
[junit4:junit4]   2> 19220 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 19220 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index.20130304012504790 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d9765; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 19223 T1919 C95 P54423 REQ /replication {command=filecontent&wt=filestream&checksum=true&generation=2&qt=/replication&file=segments_2} status=0 QTime=0 
[junit4:junit4]   2> 19225 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index
[junit4:junit4]   2> 19225 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19234 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 19235 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 19235 T1956 C93 P47539 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19235 T1956 C93 P47539 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 19235 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 19236 T1956 C93 P47539 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5de590; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5de590; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19237 T1956 C93 P47539 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19238 T1956 C93 P47539 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19238 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3
[junit4:junit4]   2> 19238 T1956 C93 P47539 oass.SolrIndexSearcher.<init> Opening Searcher@1a93dc1 main
[junit4:junit4]   2> 19239 T1955 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a93dc1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 19239 T1955 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index
[junit4:junit4]   2> 19240 T1956 C93 P47539 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index.20130304012504790 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d9765; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 19240 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index.20130304012504790
[junit4:junit4]   2> 19240 T1956 C93 P47539 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty3/index
[junit4:junit4]   2> 19240 T1956 C93 P47539 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 19241 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 19241 T1956 C93 P47539 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 19241 T1956 C93 P47539 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19243 T1956 C93 P47539 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 19338 T1916 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 19344 T1916 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 19346 T1916 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 19358 T1916 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19362 T1916 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19365 T1916 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19366 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19366 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19367 T1916 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19368 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19368 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19368 T1916 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362374689034/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection/
[junit4:junit4]   2> 19369 T1916 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1adeb57
[junit4:junit4]   2> 19369 T1916 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 19370 T1916 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection forceNew:false
[junit4:junit4]   2> 19370 T1916 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection
[junit4:junit4]   2> 19370 T1916 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection/index/
[junit4:junit4]   2> 19371 T1916 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 19371 T1916 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection/index forceNew:false
[junit4:junit4]   2> 19374 T1916 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@18d36bc; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19375 T1916 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19375 T1916 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection/index
[junit4:junit4]   2> 19376 T1916 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 19377 T1916 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 19377 T1916 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 19378 T1916 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 19378 T1916 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 19378 T1916 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 19379 T1916 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 19379 T1916 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 19379 T1916 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 19382 T1916 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 19384 T1916 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362374685574/onenodecollection
[junit4:junit4]   2> 19385 T1916 oass.SolrIndexSearcher.<init> Opening Searcher@7dc7f2 main
[junit4:junit4]   2> 19385 T1916 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 19385 T1916 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 19389 T1975 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@7dc7f2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 19390 T1916 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 20047 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20049 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55192/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55192_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5"}
[junit4:junit4]   2> 20053 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47539/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47539_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4"}
[junit4:junit4]   2> 20057 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54423/u",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54423_u",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null}
[junit4:junit4]   2> 20057 T1905 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 20058 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 20063 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20063 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20063 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20063 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20063 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20063 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20392 T1916 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 20393 T1916 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:54423/u collection:onenodecollection shard:shard1
[junit4:junit4]   2> 20394 T1916 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 20405 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:delete cxid:0xa6 zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4]   2> 20406 T1916 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 20407 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:create cxid:0xa7 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20410 T1916 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 20411 T1916 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 20411 T1916 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54423/u/onenodecollectioncore/
[junit4:junit4]   2> 20412 T1916 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 20412 T1916 oasc.SyncStrategy.syncToMe http://127.0.0.1:54423/u/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 20413 T1916 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54423/u/onenodecollectioncore/
[junit4:junit4]   2> 20413 T1916 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> 20421 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d33dbf38b0006 type:create cxid:0xb1 zxid:0xc8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21574 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21585 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21585 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21585 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21585 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21585 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21585 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21628 T1916 oasc.ZkController.register We are http://127.0.0.1:54423/u/onenodecollectioncore/ and leader is http://127.0.0.1:54423/u/onenodecollectioncore/
[junit4:junit4]   2> 21628 T1916 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:54423/u
[junit4:junit4]   2> 21629 T1916 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 21629 T1916 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 21631 T1916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21633 T1882 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 21634 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22637 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C94_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:55192/u, node_name=127.0.0.1:55192_u, core=collection1, state=recovering, shard=shard1}
[junit4:junit4]   2> 22829 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:38088/u/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 22829 T1972 C94 P55192 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55192/u START replicas=[http://127.0.0.1:38088/u/collection1/] nUpdates=100
[junit4:junit4]   2> 22830 T1972 C94 P55192 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 22830 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 22830 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 22831 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 22831 T1972 C94 P55192 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 22831 T1972 C94 P55192 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:38088/u/collection1/. core=collection1
[junit4:junit4]   2> 22832 T1972 C94 P55192 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C96 name=collection1 org.apache.solr.core.SolrCore@13899f6 url=http://127.0.0.1:38088/u/collection1 node=127.0.0.1:38088_u C96_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:38088/u, node_name=127.0.0.1:38088_u, core=collection1, state=active, shard=shard1, leader=true}
[junit4:junit4]   2> 22838 T1932 C96 P38088 REQ /get {getVersions=100&version=2&wt=javabin&qt=/get&distrib=false} status=0 QTime=0 
[junit4:junit4]   2> 22841 T1934 C96 P38088 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22842 T1934 C96 P38088 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2
[junit4:junit4]   2> 22845 T1934 C96 P38088 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1233e18; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22846 T1934 C96 P38088 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22854 T1934 C96 P38088 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1233e18; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1233e18; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22854 T1934 C96 P38088 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22855 T1934 C96 P38088 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2
[junit4:junit4]   2> 22856 T1934 C96 P38088 oass.SolrIndexSearcher.<init> Opening Searcher@1572b1b realtime
[junit4:junit4]   2> 22857 T1934 C96 P38088 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22857 T1934 C96 P38088 /update {version=2&softCommit=false&wt=javabin&openSearcher=false&commit_end_point=true&waitSearcher=true&commit=true} {commit=} 0 16
[junit4:junit4]   2> 22858 T1972 C94 P55192 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 22858 T1972 C94 P55192 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 22861 T1932 C96 P38088 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 22862 T1932 C96 P38088 REQ /replication {command=indexversion&version=2&wt=javabin&qt=/replication} status=0 QTime=2 
[junit4:junit4]   2> 22863 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 22863 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 22863 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 22866 T1933 C96 P38088 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2
[junit4:junit4]   2> 22867 T1933 C96 P38088 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty2/index
[junit4:junit4]   2> 22867 T1933 C96 P38088 REQ /replication {command=filelist&version=2&wt=javabin&generation=2&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 22868 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 22869 T1972 C94 P55192 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index.20130304012508440 forceNew:false
[junit4:junit4]   2> 22870 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 22870 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index.20130304012508440 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d2e441; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 22874 T1934 C96 P38088 REQ /replication {command=filecontent&wt=filestream&checksum=true&generation=2&qt=/replication&file=segments_2} status=0 QTime=0 
[junit4:junit4]   2> 22876 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index
[junit4:junit4]   2> 22876 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 22884 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 22885 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 22885 T1972 C94 P55192 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 22885 T1972 C94 P55192 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 22886 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 22888 T1972 C94 P55192 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2bd3c7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2bd3c7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22889 T1972 C94 P55192 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22890 T1972 C94 P55192 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 22890 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4
[junit4:junit4]   2> 22891 T1972 C94 P55192 oass.SolrIndexSearcher.<init> Opening Searcher@1fe2860 main
[junit4:junit4]   2> 22892 T1971 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fe2860 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22892 T1971 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index
[junit4:junit4]   2> 22893 T1972 C94 P55192 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index.20130304012508440 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d2e441; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 22893 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index.20130304012508440
[junit4:junit4]   2> 22894 T1972 C94 P55192 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362374685574/jetty4/index
[junit4:junit4]   2> 22894 T1972 C94 P55192 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 22894 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 22894 T1972 C94 P55192 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 22895 T1972 C94 P55192 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 22897 T1972 C94 P55192 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 23094 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23095 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54423/u",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54423_u",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null}
[junit4:junit4]   2> 23099 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:55192/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:55192_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5"}
[junit4:junit4]   2> 23124 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23124 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23124 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23124 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23124 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23124 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23404 T821 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 23639 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23641 T1882 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 23641 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23697 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:41412 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ef12d1
[junit4:junit4]   2> 23698 T1978 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:41412. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 23698 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 23699 T1978 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:41412, initiating session
[junit4:junit4]   2> 23699 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:55715
[junit4:junit4]   2> 23699 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:55715
[junit4:junit4]   2> 23700 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d33dbf38b000d with negotiated timeout 10000 for client /127.0.0.1:55715
[junit4:junit4]   2> 23700 T1978 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:41412, sessionid = 0x13d33dbf38b000d, negotiated timeout = 10000
[junit4:junit4]   2> 23701 T1979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef12d1 name:ZooKeeperConnection Watcher:127.0.0.1:41412 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 23701 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 23761 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b000d
[junit4:junit4]   2> 23762 T1979 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 23762 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55715 which had sessionid 0x13d33dbf38b000d
[junit4:junit4]   2> 23762 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b000d closed
[junit4:junit4]   2> 23763 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d33dbf38b0004
[junit4:junit4]   2> 23764 T1910 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 23764 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:55674 which had sessionid 0x13d33dbf38b0004
[junit4:junit4]   2> 23764 T1882 oaz.ZooKeeper.close Session: 0x13d33dbf38b0004 closed
[junit4:junit4]   2> 23769 T1882 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 34619
[junit4:junit4]   2> 23769 T1882 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=25675500
[junit4:junit4]   2> 24632 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24633 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34619/u",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34619_u",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1"}
[junit4:junit4]   2> 24639 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24639 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24639 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24639 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24639 T1969 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25771 T1882 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@136d80
[junit4:junit4]   2> 25773 T1882 oasc.CachingDirectoryFactory.close Releasing directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./o

[...truncated too long message...]

ed([46D2BCF0926546AF:C73432E8E53A2693]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 134979 T2601 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 134989 T2600 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 135765 T2604 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=sr_BA, timezone=America/Argentina/San_Juan
[junit4:junit4]   2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=41145904,total=219213824
[junit4:junit4]   2> NOTE: All tests run in this JVM: [BadComponentTest, TestDFRSimilarityFactory, TestRandomFaceting, DefaultValueUpdateProcessorTest, TestSolrXMLSerializer, TestSurroundQueryParser, MBeansHandlerTest, TestExtendedDismaxParser, TestOmitPositions, TestRandomDVFaceting, XsltUpdateRequestHandlerTest, CoreAdminHandlerTest, AnalysisAfterCoreReloadTest, TestCoreContainer, SliceStateTest, OverseerCollectionProcessorTest, DisMaxRequestHandlerTest, TestBinaryField, SuggesterTest, TestFastWriter, TestSearchPerf, SampleTest, TestSweetSpotSimilarityFactory, TestFoldingMultitermQuery, QueryElevationComponentTest, SuggesterFSTTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, SolrRequestParserTest, SliceStateUpdateTest, RAMDirectoryFactoryTest, ScriptEngineTest, TestIndexingPerformance, MoreLikeThisHandlerTest, XmlUpdateRequestHandlerTest, TestPartialUpdateDeduplication, LoggingHandlerTest, QueryParsingTest, LegacyHTMLStripCharFilterTest, TestSolrJ, TestStressLucene, SynonymTokenizerTest, PreAnalyzedFieldTest, DistributedTermsComponentTest, CacheHeaderTest, NumericFieldsTest, ShowFileRequestHandlerTest, TestConfig, SOLR749Test, DOMUtilTest, DebugComponentTest, SpatialFilterTest, TestSolrCoreProperties, TestPHPSerializedResponseWriter, TestElisionMultitermQuery, PluginInfoTest, TestFiltering, SolrIndexConfigTest, TestCharFilters, TestRangeQuery, ReturnFieldsTest, OverseerTest, SpellCheckComponentTest, FullSolrCloudDistribCmdsTest, LeaderElectionIntegrationTest, BasicZkTest, TestHashPartitioner, SolrCoreTest, IndexBasedSpellCheckerTest, DirectUpdateHandlerTest, TestMultiCoreConfBootstrap, SimpleFacetsTest, TestGroupingSearch, FileBasedSpellCheckerTest, PeerSyncTest, SortByFunctionTest, SignatureUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestJmxIntegration, TestIndexSearcher, DirectSolrConnectionTest, TestWordDelimiterFilterFactory, PolyFieldTest, DocumentBuilderTest, TestPseudoReturnFields, TermsComponentTest, MinimalSchemaTest, PingRequestHandlerTest, TermVectorComponentTest, DirectUpdateHandlerOptimizeTest, TestValueSourceCache, SearchHandlerTest, TestArbitraryIndexDir, SuggesterTSTTest, UniqFieldsUpdateProcessorFactoryTest, BadIndexSchemaTest, UpdateRequestProcessorFactoryTest, TestWriterPerf, AlternateDirectoryTest, TestSolrDeletionPolicy2, TestLFUCache, TestQuerySenderNoQuery, TestNumberUtils, EchoParamsTest, SpellPossibilityIteratorTest, TestPhraseSuggestions, TestPerFieldSimilarity, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastLRUCache, URLClassifyProcessorTest, FileUtilsTest, TestBadConfig, UUIDFieldTest, TestUtils, ZkNodePropsTest, CircularListTest, TestDocumentBuilder, PathHierarchyTokenizerFactoryTest, TestCollationKeyRangeQueries, BasicDistributedZk2Test, ClusterStateTest, ClusterStateUpdateTest, CollectionsAPIDistributedZkTest, TestZkChroot, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 136.02s, 1 test, 1 failure <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1207: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:870: There were test failures: 260 suites, 1094 tests, 1 error, 1 failure, 9 ignored (3 assumptions)

Total time: 35 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



RE: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4533 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
> > The parent process or the worker child?
> 
> The parent. The reason here was to avoid spawning a background thread on
> the child to avoid any interference with existing tests. So the parent tracks
> events that tell where the child is going (entering or leaving a suite/ test) and
> is from this deducing where a child may be.
> The <unknown> status means the child is not executing any suite; it used to
> be the case that OOM-ed code would hang forever on System.exit, for
> example...
> 
> > Can you see from the messages *where* it might hang?
> 
> Not really, not if it's a JVM issue.
> 
> > Interestingly another one is now hanging with the following message:
> >
> > [junit4:junit4] HEARTBEAT J0 PID(11405@serv1): 2013-03-04T13:16:16,
> > stalled for 7086s at:
> > UIMABaseAnalyzerTest.baseUIMAAnalyzerIntegrationTest
> 
> If this one is not responsive to regular stack trace probing then it's definitely a
> JVM freeze somewhere.

It was also frozen! Was only possible to kill -9. Unfortunately attaching with gdb did not work to me, I'll try next time again.

Uwe


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4533 - Still Failing!

Posted by Dawid Weiss <da...@cs.put.poznan.pl>.
> The parent process or the worker child?

The parent. The reason here was to avoid spawning a background thread
on the child to avoid any interference with existing tests. So the
parent tracks events that tell where the child is going (entering or
leaving a suite/ test) and is from this deducing where a child may be.
The <unknown> status means the child is not executing any suite; it
used to be the case that OOM-ed code would hang forever on
System.exit, for example...

> Can you see from the messages *where* it might hang?

Not really, not if it's a JVM issue.

> Interestingly another one is now hanging with the following message:
>
> [junit4:junit4] HEARTBEAT J0 PID(11405@serv1): 2013-03-04T13:16:16, stalled for 7086s at: UIMABaseAnalyzerTest.baseUIMAAnalyzerIntegrationTest

If this one is not responsive to regular stack trace probing then it's
definitely a JVM freeze somewhere.

D.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4533 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
I can try to hook it up with gdb and report to the hotspot mailing list. Unfortunately, we have nothing to report, only that the JVM hangs. Who is printing the messages? The parent process or the worker child? If the parent prints them, the child can be dead altogether, otherwise it might still be able to print messages. Can you see from the messages *where* it might hang?

[junit4:junit4] HEARTBEAT J0 PID(6790@serv1): 2013-03-04T08:01:06, stalled for 2464s at: <unknown>

Interestingly another one is now hanging with the following message:

[junit4:junit4] HEARTBEAT J0 PID(11405@serv1): 2013-03-04T13:16:16, stalled for 7086s at: UIMABaseAnalyzerTest.baseUIMAAnalyzerIntegrationTest

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: dawid.weiss@gmail.com [mailto:dawid.weiss@gmail.com] On Behalf
> Of Dawid Weiss
> Sent: Monday, March 04, 2013 9:12 AM
> To: dev@lucene.apache.org
> Subject: Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
> 4533 - Still Failing!
> 
> It'd be nice to get a native stack/ core dump of this via gdb and report back to
> the hotspot folks. I know too little about gdb to help here but I bet it's
> possible.
> 
> Dawid
> 
> On Mon, Mar 4, 2013 at 9:03 AM, Uwe Schindler <uw...@thetaphi.de> wrote:
> > Killed again! Again 32 bit JDK8 with G1 Collector
> >
> > -----
> > Uwe Schindler
> > H.-H.-Meier-Allee 63, D-28213 Bremen
> > http://www.thetaphi.de
> > eMail: uwe@thetaphi.de
> >
> >> -----Original Message-----
> >> From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
> >> Sent: Monday, March 04, 2013 9:02 AM
> >> To: dev@lucene.apache.org
> >> Subject: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) -
> >> Build #
> >> 4533 - Still Failing!
> >>
> >> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4533/
> >> Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC
> >>
> >> All tests passed
> >>
> >> Build Log:
> >> [...truncated 5917 lines...]
> >> [junit4:junit4] ERROR: JVM J0 ended with an exception, command line:
> >> /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre/bin/java
> >> -client - XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -
> >> XX:HeapDumpPath=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/heapdumps -Dtests.prefix=tests -Dtests.seed=3B99A947D2A6DD6D
> -
> >> Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false
> >> - Dtests.codec=random -Dtests.postingsformat=random -
> >> Dtests.docvaluesformat=random -Dtests.locale=random -
> >> Dtests.timezone=random -Dtests.directory=random -
> >> Dtests.linedocsfile=europarl.lines.txt.gz
> >> -Dtests.luceneMatchVersion=4.2 - Dtests.cleanthreads=perMethod -
> >> Djava.util.logging.config.file=/mnt/ssd/jenkins/workspace/Lucene-Solr
> >> -4.x- Linux/lucene/tools/junit4/logging.properties
> >> -Dtests.nightly=false - Dtests.weekly=false -Dtests.slow=true
> >> -Dtests.asserts.gracious=false -
> >> Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -
> >> Djunit4.tempDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/build/analysis/uima/test/temp -
> >> Dclover.db.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/build/clover/db -
> >> Djava.security.manager=org.apache.lucene.util.TestSecurityManager -
> >> Djava.security.policy=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/tools/junit4/tests.policy -Dlucene.version=4.2-SNAPSHOT
> >> -
> >> Djetty.testMode=1 -Djetty.insecurerandom=1 -
> >> Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -
> >> Djava.awt.headless=true -classpath
> /mnt/ssd/jenkins/workspace/Lucene-
> >> Solr-4.x-
> >> Linux/lucene/build/analysis/uima/classes/test:/mnt/ssd/jenkins/worksp
> >> ace
> >> /Lucene-Solr-4.x-Linux/lucene/build/test-
> >> framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Luc
> >> en
> >> e-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-
> common
> >> -
> >> 4.2-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/analysis/uima/src/test-
> >> files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/analysis/uima/lib/Tagger-
> >> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/analysis/uima/lib/WhitespaceTokenizer-
> >> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/analysis/uima/lib/uimaj-core-
> >> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >>
> Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucen
> >> e-
> >> Solr-4.x-Linux/lucene/test-framework/lib/junit-
> >> 4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test
> >> -
> >> framework/lib/randomizedtesting-runner-
> >> 2.0.8.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/build/analysis/uima/classes/java:/var/lib/jenkins/tools/
> >> hudson
> >> .tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-
> >> launcher.jar:/var/lib/jenkins/.ant/lib/ivy-
> >> 2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT
> >> _1.8.2/
> >> lib/ant-
> >> jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1
> >> .8.2/lib
> >> /ant-
> >> swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT
> >> _1.8.2
> >> /lib/ant-apache-
> >> oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1
> >> .8.2/li
> >> b/ant-
> >> jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1
> >> .8.2/li
> >> b/ant-apache-
> >>
> xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> >> 2/lib/ant-
> >>
> javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> >> 8.2/lib/ant-apache-
> >>
> resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> >> 8.2/lib/ant-
> >>
> testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> >> 2/lib/ant-commons-
> >>
> logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> >> 2/lib/ant-apache-
> >> log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT
> >> _1.8.2/
> >> lib/ant-
> >> junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT
> >> _1.8.2/
> >> lib/ant-
> >> jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_
> >> 1.8.2/li
> >> b/ant-commons-
> >> net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1
> >> .8.2/li
> >> b/ant-apache-
> >> bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1
> >> .8.2/li
> >> b/ant-
> >>
> jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> >> 8.2/lib/ant-
> >>
> netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> >> 8.2/lib/ant-apache-
> >>
> regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> >> 2/lib/ant-
> >> junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/AN
> >> T_1.8.2
> >> /lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/
> >> ANT_1.8
> >> .2/lib/ant-apache-
> >> bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_
> >> 1.8.2/l
> >> ib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-
> >> b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.rando
> >> mizedt esting/junit4-ant/jars/junit4-ant-2.0.8.jar
> >> -ea:org.apache.lucene... - ea:org.apache.solr...
> >> com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe - flush
> >> -eventsfile /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/build/analysis/uima/test/temp/junit4-J0-
> >> 20130304_071954_744.events @/mnt/ssd/jenkins/workspace/Lucene-
> Solr-
> >> 4.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-
> >> 20130304_071954_744.suites
> >> [junit4:junit4] ERROR: JVM J0 ended with an exception: Forked process
> >> returned with error code: 137.
> >> [junit4:junit4]       at
> >> com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1253)
> >> [junit4:junit4]       at
> >> com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:66)
> >> [junit4:junit4]       at
> >> com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:821)
> >> [junit4:junit4]       at
> >> com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:818)
> >> [junit4:junit4]       at
> java.util.concurrent.FutureTask.run(FutureTask.java:262)
> >> [junit4:junit4]       at
> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
> >> jav
> >> a:1110)
> >> [junit4:junit4]       at
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
> >> .ja
> >> va:603)
> >> [junit4:junit4]       at java.lang.Thread.run(Thread.java:722)
> >>
> >> BUILD FAILED
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The
> >> following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The
> >> following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The
> >> following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build.xml:548:
> >> The following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> >> build.xml:1751: The following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/analysis/build.xml:105: The following error occurred
> >> while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> >> Linux/lucene/analysis/build.xml:38: The following error occurred
> >> while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-
> >> build.xml:61: The following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> >> build.xml:1207: The following error occurred while executing this line:
> >> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> >> build.xml:870: At least one slave process threw an exception, first:
> >> Forked process returned with error code: 137.
> >>
> >> Total time: 57 minutes 15 seconds
> >> Build step 'Invoke Ant' marked build as failure Archiving artifacts
> >> Recording test results Description set: Java: 32bit/jdk1.8.0-ea-b79
> >> -client -XX:+UseG1GC Email was triggered for: Failure Sending email
> >> for trigger: Failure
> >>
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > additional commands, e-mail: dev-help@lucene.apache.org
> >
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4533 - Still Failing!

Posted by Dawid Weiss <da...@cs.put.poznan.pl>.
It'd be nice to get a native stack/ core dump of this via gdb and
report back to the hotspot folks. I know too little about gdb to help
here but I bet it's possible.

Dawid

On Mon, Mar 4, 2013 at 9:03 AM, Uwe Schindler <uw...@thetaphi.de> wrote:
> Killed again! Again 32 bit JDK8 with G1 Collector
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>> -----Original Message-----
>> From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
>> Sent: Monday, March 04, 2013 9:02 AM
>> To: dev@lucene.apache.org
>> Subject: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
>> 4533 - Still Failing!
>>
>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4533/
>> Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC
>>
>> All tests passed
>>
>> Build Log:
>> [...truncated 5917 lines...]
>> [junit4:junit4] ERROR: JVM J0 ended with an exception, command line:
>> /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre/bin/java -client -
>> XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -
>> XX:HeapDumpPath=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/heapdumps -Dtests.prefix=tests -Dtests.seed=3B99A947D2A6DD6D -
>> Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -
>> Dtests.codec=random -Dtests.postingsformat=random -
>> Dtests.docvaluesformat=random -Dtests.locale=random -
>> Dtests.timezone=random -Dtests.directory=random -
>> Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=4.2 -
>> Dtests.cleanthreads=perMethod -
>> Djava.util.logging.config.file=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -
>> Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -
>> Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -
>> Djunit4.tempDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/build/analysis/uima/test/temp -
>> Dclover.db.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/build/clover/db -
>> Djava.security.manager=org.apache.lucene.util.TestSecurityManager -
>> Djava.security.policy=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/tools/junit4/tests.policy -Dlucene.version=4.2-SNAPSHOT -
>> Djetty.testMode=1 -Djetty.insecurerandom=1 -
>> Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -
>> Djava.awt.headless=true -classpath /mnt/ssd/jenkins/workspace/Lucene-
>> Solr-4.x-
>> Linux/lucene/build/analysis/uima/classes/test:/mnt/ssd/jenkins/workspace
>> /Lucene-Solr-4.x-Linux/lucene/build/test-
>> framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucen
>> e-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-
>> 4.2-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/analysis/uima/src/test-
>> files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/analysis/uima/lib/Tagger-
>> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/analysis/uima/lib/WhitespaceTokenizer-
>> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/analysis/uima/lib/uimaj-core-
>> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-
>> Solr-4.x-Linux/lucene/test-framework/lib/junit-
>> 4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-
>> framework/lib/randomizedtesting-runner-
>> 2.0.8.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/build/analysis/uima/classes/java:/var/lib/jenkins/tools/hudson
>> .tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-
>> launcher.jar:/var/lib/jenkins/.ant/lib/ivy-
>> 2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/
>> lib/ant-
>> jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib
>> /ant-
>> swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
>> /lib/ant-apache-
>> oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
>> b/ant-
>> jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
>> b/ant-apache-
>> xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
>> 2/lib/ant-
>> javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
>> 8.2/lib/ant-apache-
>> resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
>> 8.2/lib/ant-
>> testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
>> 2/lib/ant-commons-
>> logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
>> 2/lib/ant-apache-
>> log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/
>> lib/ant-
>> junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/
>> lib/ant-
>> jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
>> b/ant-commons-
>> net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
>> b/ant-apache-
>> bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
>> b/ant-
>> jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
>> 8.2/lib/ant-
>> netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
>> 8.2/lib/ant-apache-
>> regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
>> 2/lib/ant-
>> junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
>> /lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8
>> .2/lib/ant-apache-
>> bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/l
>> ib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-
>> b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedt
>> esting/junit4-ant/jars/junit4-ant-2.0.8.jar -ea:org.apache.lucene... -
>> ea:org.apache.solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -
>> flush -eventsfile /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/build/analysis/uima/test/temp/junit4-J0-
>> 20130304_071954_744.events @/mnt/ssd/jenkins/workspace/Lucene-Solr-
>> 4.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-
>> 20130304_071954_744.suites
>> [junit4:junit4] ERROR: JVM J0 ended with an exception: Forked process
>> returned with error code: 137.
>> [junit4:junit4]       at
>> com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1253)
>> [junit4:junit4]       at
>> com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:66)
>> [junit4:junit4]       at
>> com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:821)
>> [junit4:junit4]       at
>> com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:818)
>> [junit4:junit4]       at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> [junit4:junit4]       at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav
>> a:1110)
>> [junit4:junit4]       at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja
>> va:603)
>> [junit4:junit4]       at java.lang.Thread.run(Thread.java:722)
>>
>> BUILD FAILED
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The
>> following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The
>> following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The
>> following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:548:
>> The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
>> build.xml:1751: The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/analysis/build.xml:105: The following error occurred while
>> executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
>> Linux/lucene/analysis/build.xml:38: The following error occurred while
>> executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-
>> build.xml:61: The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
>> build.xml:1207: The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
>> build.xml:870: At least one slave process threw an exception, first: Forked
>> process returned with error code: 137.
>>
>> Total time: 57 minutes 15 seconds
>> Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording
>> test results Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC
>> Email was triggered for: Failure Sending email for trigger: Failure
>>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4533 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
Killed again! Again 32 bit JDK8 with G1 Collector

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de

> -----Original Message-----
> From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
> Sent: Monday, March 04, 2013 9:02 AM
> To: dev@lucene.apache.org
> Subject: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
> 4533 - Still Failing!
> 
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4533/
> Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC
> 
> All tests passed
> 
> Build Log:
> [...truncated 5917 lines...]
> [junit4:junit4] ERROR: JVM J0 ended with an exception, command line:
> /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre/bin/java -client -
> XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -
> XX:HeapDumpPath=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/heapdumps -Dtests.prefix=tests -Dtests.seed=3B99A947D2A6DD6D -
> Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -
> Dtests.codec=random -Dtests.postingsformat=random -
> Dtests.docvaluesformat=random -Dtests.locale=random -
> Dtests.timezone=random -Dtests.directory=random -
> Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=4.2 -
> Dtests.cleanthreads=perMethod -
> Djava.util.logging.config.file=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -
> Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -
> Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -
> Djunit4.tempDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build/analysis/uima/test/temp -
> Dclover.db.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build/clover/db -
> Djava.security.manager=org.apache.lucene.util.TestSecurityManager -
> Djava.security.policy=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/tools/junit4/tests.policy -Dlucene.version=4.2-SNAPSHOT -
> Djetty.testMode=1 -Djetty.insecurerandom=1 -
> Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -
> Djava.awt.headless=true -classpath /mnt/ssd/jenkins/workspace/Lucene-
> Solr-4.x-
> Linux/lucene/build/analysis/uima/classes/test:/mnt/ssd/jenkins/workspace
> /Lucene-Solr-4.x-Linux/lucene/build/test-
> framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucen
> e-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-
> 4.2-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/analysis/uima/src/test-
> files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/analysis/uima/lib/Tagger-
> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/analysis/uima/lib/WhitespaceTokenizer-
> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/analysis/uima/lib/uimaj-core-
> 2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-
> Solr-4.x-Linux/lucene/test-framework/lib/junit-
> 4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-
> framework/lib/randomizedtesting-runner-
> 2.0.8.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build/analysis/uima/classes/java:/var/lib/jenkins/tools/hudson
> .tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-
> launcher.jar:/var/lib/jenkins/.ant/lib/ivy-
> 2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/
> lib/ant-
> jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib
> /ant-
> swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> /lib/ant-apache-
> oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
> b/ant-
> jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
> b/ant-apache-
> xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> 2/lib/ant-
> javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> 8.2/lib/ant-apache-
> resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> 8.2/lib/ant-
> testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> 2/lib/ant-commons-
> logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> 2/lib/ant-apache-
> log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/
> lib/ant-
> junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/
> lib/ant-
> jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
> b/ant-commons-
> net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
> b/ant-apache-
> bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/li
> b/ant-
> jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> 8.2/lib/ant-
> netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.
> 8.2/lib/ant-apache-
> regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.
> 2/lib/ant-
> junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
> /lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8
> .2/lib/ant-apache-
> bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/l
> ib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-
> b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedt
> esting/junit4-ant/jars/junit4-ant-2.0.8.jar -ea:org.apache.lucene... -
> ea:org.apache.solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -
> flush -eventsfile /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/build/analysis/uima/test/temp/junit4-J0-
> 20130304_071954_744.events @/mnt/ssd/jenkins/workspace/Lucene-Solr-
> 4.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-
> 20130304_071954_744.suites
> [junit4:junit4] ERROR: JVM J0 ended with an exception: Forked process
> returned with error code: 137.
> [junit4:junit4] 	at
> com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1253)
> [junit4:junit4] 	at
> com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:66)
> [junit4:junit4] 	at
> com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:821)
> [junit4:junit4] 	at
> com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:818)
> [junit4:junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> [junit4:junit4] 	at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav
> a:1110)
> [junit4:junit4] 	at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja
> va:603)
> [junit4:junit4] 	at java.lang.Thread.run(Thread.java:722)
> 
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:548:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> build.xml:1751: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/analysis/build.xml:105: The following error occurred while
> executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-
> Linux/lucene/analysis/build.xml:38: The following error occurred while
> executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-
> build.xml:61: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> build.xml:1207: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-
> build.xml:870: At least one slave process threw an exception, first: Forked
> process returned with error code: 137.
> 
> Total time: 57 minutes 15 seconds
> Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording
> test results Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC
> Email was triggered for: Failure Sending email for trigger: Failure
> 



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4533 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4533/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 5917 lines...]
[junit4:junit4] ERROR: JVM J0 ended with an exception, command line: /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre/bin/java -client -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/heapdumps -Dtests.prefix=tests -Dtests.seed=3B99A947D2A6DD6D -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=4.2 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -Djunit4.tempDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/uima/test/temp -Dclover.db.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/clover/db -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Djava.security.policy=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/tools/junit4/tests.policy -Dlucene.version=4.2-SNAPSHOT -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -classpath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/uima/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.2-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/uima/src/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/uima/lib/Tagger-2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/uima/lib/WhitespaceTokenizer-2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/uima/lib/uimaj-core-2.3.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/uima/classes/java:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar -ea:org.apache.lucene... -ea:org.apache.solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -flush -eventsfile /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20130304_071954_744.events @/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20130304_071954_744.suites
[junit4:junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 137.
[junit4:junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1253)
[junit4:junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:66)
[junit4:junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:821)
[junit4:junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:818)
[junit4:junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 	at java.lang.Thread.run(Thread.java:722)

BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build.xml:548: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1751: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/build.xml:105: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/analysis/build.xml:38: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/module-build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1207: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:870: At least one slave process threw an exception, first: Forked process returned with error code: 137.

Total time: 57 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure