You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/03/23 15:52:58 UTC

[JENKINS] Lucene-Solr-Tests-4.2.1-Java6 - Build # 9 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.2.1-Java6/9/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:60012/_o/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:60022/_o/collection1], CloudJettyRunner [url=http://127.0.0.1:60845/_o/collection1]]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:60012/_o/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:60022/_o/collection1], CloudJettyRunner [url=http://127.0.0.1:60845/_o/collection1]]
	at __randomizedtesting.SeedInfo.seed([69859090D5C3F022:E8631E88A29C901E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8816 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T1634 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_o/
[junit4:junit4]   2> 5 T1634 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1364049782552
[junit4:junit4]   2> 6 T1634 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T1635 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 10 T1635 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 10 T1635 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 10 T1635 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 10 T1635 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 11 T1635 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1364049782551/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T1634 oasc.ZkTestServer.run start zk server on port:59987
[junit4:junit4]   2> 107 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d9cd5dc
[junit4:junit4]   2> 108 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 108 T1640 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 109 T1640 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 109 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59988
[junit4:junit4]   2> 110 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59988
[junit4:junit4]   2> 110 T1638 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 112 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0000 with negotiated timeout 10000 for client /140.211.11.196:59988
[junit4:junit4]   2> 112 T1640 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0000, negotiated timeout = 10000
[junit4:junit4]   2> 112 T1641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d9cd5dc name:ZooKeeperConnection Watcher:127.0.0.1:59987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 113 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 113 T1634 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 116 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e0000
[junit4:junit4]   2> 130 T1641 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 130 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59988 which had sessionid 0x13d97b3e71e0000
[junit4:junit4]   2> 130 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e0000 closed
[junit4:junit4]   2> 131 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@bf7fc15
[junit4:junit4]   2> 131 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 132 T1642 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 132 T1642 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 132 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59989
[junit4:junit4]   2> 133 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59989
[junit4:junit4]   2> 134 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0001 with negotiated timeout 10000 for client /140.211.11.196:59989
[junit4:junit4]   2> 134 T1642 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0001, negotiated timeout = 10000
[junit4:junit4]   2> 134 T1643 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bf7fc15 name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 134 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 135 T1634 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 138 T1634 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 140 T1634 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 143 T1634 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 145 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 146 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 151 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 152 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 262 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 262 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 274 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 275 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 283 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 283 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 293 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 294 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 308 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 309 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 312 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 313 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 316 T1634 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 316 T1634 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 319 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e0001
[junit4:junit4]   2> 326 T1643 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 326 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59989 which had sessionid 0x13d97b3e71e0001
[junit4:junit4]   2> 326 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e0001 closed
[junit4:junit4]   2> 506 T1634 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 511 T1634 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59993
[junit4:junit4]   2> 512 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 512 T1634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 513 T1634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873
[junit4:junit4]   2> 513 T1634 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/solr.xml
[junit4:junit4]   2> 514 T1634 oasc.CoreContainer.<init> New CoreContainer 1525659956
[junit4:junit4]   2> 514 T1634 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/'
[junit4:junit4]   2> 515 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/'
[junit4:junit4]   2> 564 T1634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 564 T1634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 565 T1634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 565 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 566 T1634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 566 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 566 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 567 T1634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 567 T1634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 568 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 588 T1634 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 606 T1634 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59987/solr
[junit4:junit4]   2> 607 T1634 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 607 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@9114bc4
[junit4:junit4]   2> 609 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 609 T1653 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 609 T1653 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 610 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59994
[junit4:junit4]   2> 610 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59994
[junit4:junit4]   2> 611 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0002 with negotiated timeout 20000 for client /140.211.11.196:59994
[junit4:junit4]   2> 611 T1653 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0002, negotiated timeout = 20000
[junit4:junit4]   2> 612 T1654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9114bc4 name:ZooKeeperConnection Watcher:127.0.0.1:59987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 612 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 613 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e0002
[junit4:junit4]   2> 614 T1654 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 614 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59994 which had sessionid 0x13d97b3e71e0002
[junit4:junit4]   2> 614 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e0002 closed
[junit4:junit4]   2> 614 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 625 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f4ee906
[junit4:junit4]   2> 627 T1655 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 626 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 627 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59995
[junit4:junit4]   2> 627 T1655 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 628 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59995
[junit4:junit4]   2> 629 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0003 with negotiated timeout 20000 for client /140.211.11.196:59995
[junit4:junit4]   2> 629 T1655 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0003, negotiated timeout = 20000
[junit4:junit4]   2> 629 T1656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f4ee906 name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 629 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 631 T1634 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 634 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 635 T1634 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 639 T1634 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 641 T1634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59993__o
[junit4:junit4]   2> 642 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59993__o Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59993__o
[junit4:junit4]   2> 642 T1634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59993__o
[junit4:junit4]   2> 645 T1634 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 650 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 650 T1634 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 652 T1634 oasc.Overseer.start Overseer (id=89394366549721091-127.0.0.1:59993__o-n_0000000000) starting
[junit4:junit4]   2> 653 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 654 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 655 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 656 T1634 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 659 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 661 T1658 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 662 T1634 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 672 T1634 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 674 T1634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 676 T1657 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 681 T1659 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/collection1
[junit4:junit4]   2> 681 T1659 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 681 T1659 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 682 T1659 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 683 T1659 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/collection1/'
[junit4:junit4]   2> 684 T1659 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 684 T1659 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/collection1/lib/README' to classloader
[junit4:junit4]   2> 738 T1659 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 794 T1659 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 895 T1659 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 901 T1659 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1496 T1659 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1507 T1659 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1512 T1659 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1525 T1659 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1530 T1659 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1534 T1659 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1535 T1659 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1536 T1659 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1536 T1659 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1537 T1659 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1537 T1659 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1537 T1659 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1538 T1659 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1364049782873/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/control/data/
[junit4:junit4]   2> 1538 T1659 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@174aa60
[junit4:junit4]   2> 1538 T1659 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1539 T1659 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/control/data forceNew: false
[junit4:junit4]   2> 1539 T1659 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1364049782551/control/data/index/
[junit4:junit4]   2> 1539 T1659 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1364049782551/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1541 T1659 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/control/data/index forceNew: false
[junit4:junit4]   2> 1573 T1659 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115483tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@319f8018),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1573 T1659 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1576 T1659 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1577 T1659 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1577 T1659 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1578 T1659 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1578 T1659 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1578 T1659 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1579 T1659 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1579 T1659 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1579 T1659 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1587 T1659 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1593 T1659 oass.SolrIndexSearcher.<init> Opening Searcher@50bbc655 main
[junit4:junit4]   2> 1594 T1659 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/control/data/tlog
[junit4:junit4]   2> 1595 T1659 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1595 T1659 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1598 T1660 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50bbc655 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1600 T1659 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1600 T1659 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2179 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2180 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59993__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59993/_o"}
[junit4:junit4]   2> 2180 T1657 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2181 T1657 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2185 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2602 T1659 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2602 T1659 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59993/_o collection:control_collection shard:shard1
[junit4:junit4]   2> 2603 T1659 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2641 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2642 T1659 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2643 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2652 T1659 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2652 T1659 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2652 T1659 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59993/_o/collection1/
[junit4:junit4]   2> 2653 T1659 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2653 T1659 oasc.SyncStrategy.syncToMe http://127.0.0.1:59993/_o/collection1/ has no replicas
[junit4:junit4]   2> 2653 T1659 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59993/_o/collection1/
[junit4:junit4]   2> 2653 T1659 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2657 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3690 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3707 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3737 T1659 oasc.ZkController.register We are http://127.0.0.1:59993/_o/collection1/ and leader is http://127.0.0.1:59993/_o/collection1/
[junit4:junit4]   2> 3737 T1659 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59993/_o
[junit4:junit4]   2> 3737 T1659 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3737 T1659 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3737 T1659 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3739 T1659 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3740 T1634 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3740 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3740 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3749 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3750 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e4282f4
[junit4:junit4]   2> 3750 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3751 T1661 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3751 T1661 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 3751 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59999
[junit4:junit4]   2> 3752 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59999
[junit4:junit4]   2> 3753 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0004 with negotiated timeout 10000 for client /140.211.11.196:59999
[junit4:junit4]   2> 3753 T1661 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0004, negotiated timeout = 10000
[junit4:junit4]   2> 3753 T1662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e4282f4 name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3753 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3754 T1634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3756 T1634 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3873 T1634 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3875 T1634 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60002
[junit4:junit4]   2> 3876 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3876 T1634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3876 T1634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302
[junit4:junit4]   2> 3877 T1634 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/solr.xml
[junit4:junit4]   2> 3877 T1634 oasc.CoreContainer.<init> New CoreContainer 1919635431
[junit4:junit4]   2> 3877 T1634 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/'
[junit4:junit4]   2> 3878 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/'
[junit4:junit4]   2> 3909 T1634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3909 T1634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3910 T1634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3910 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3910 T1634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3910 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3911 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3911 T1634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3911 T1634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3912 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3924 T1634 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3936 T1634 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59987/solr
[junit4:junit4]   2> 3937 T1634 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3937 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5147788d
[junit4:junit4]   2> 3938 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3938 T1672 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3939 T1672 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 3939 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60004
[junit4:junit4]   2> 3939 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60004
[junit4:junit4]   2> 3940 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0005 with negotiated timeout 20000 for client /140.211.11.196:60004
[junit4:junit4]   2> 3940 T1672 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0005, negotiated timeout = 20000
[junit4:junit4]   2> 3940 T1673 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5147788d name:ZooKeeperConnection Watcher:127.0.0.1:59987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3940 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3941 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e0005
[junit4:junit4]   2> 3942 T1673 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3942 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60004 which had sessionid 0x13d97b3e71e0005
[junit4:junit4]   2> 3942 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e0005 closed
[junit4:junit4]   2> 3942 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3948 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1375061b
[junit4:junit4]   2> 3949 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3949 T1674 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3950 T1674 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 3950 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60005
[junit4:junit4]   2> 3950 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60005
[junit4:junit4]   2> 3951 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0006 with negotiated timeout 20000 for client /140.211.11.196:60005
[junit4:junit4]   2> 3951 T1674 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0006, negotiated timeout = 20000
[junit4:junit4]   2> 3951 T1675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1375061b name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3951 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3952 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3953 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3955 T1634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4958 T1634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60002__o
[junit4:junit4]   2> 4959 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60002__o Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60002__o
[junit4:junit4]   2> 4960 T1634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60002__o
[junit4:junit4]   2> 4963 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4963 T1675 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4963 T1662 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4965 T1656 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4992 T1676 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/collection1
[junit4:junit4]   2> 4993 T1676 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4993 T1676 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4993 T1676 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4995 T1676 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/collection1/'
[junit4:junit4]   2> 4996 T1676 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4996 T1676 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/collection1/lib/README' to classloader
[junit4:junit4]   2> 5044 T1676 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 5103 T1676 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5204 T1676 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5210 T1676 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5211 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5212 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:59993__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:59993/_o"}
[junit4:junit4]   2> 5238 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5238 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5238 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5815 T1676 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5823 T1676 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5825 T1676 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5835 T1676 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5838 T1676 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5841 T1676 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5842 T1676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5842 T1676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5842 T1676 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5843 T1676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5843 T1676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5843 T1676 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5843 T1676 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1364049786302/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty1/
[junit4:junit4]   2> 5843 T1676 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@174aa60
[junit4:junit4]   2> 5844 T1676 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5844 T1676 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty1 forceNew: false
[junit4:junit4]   2> 5844 T1676 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty1/index/
[junit4:junit4]   2> 5845 T1676 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5846 T1676 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty1/index forceNew: false
[junit4:junit4]   2> 5855 T1676 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5855 T1676 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5857 T1676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5857 T1676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5857 T1676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5858 T1676 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5858 T1676 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5858 T1676 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5858 T1676 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5859 T1676 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5859 T1676 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5864 T1676 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5868 T1676 oass.SolrIndexSearcher.<init> Opening Searcher@3540be79 main
[junit4:junit4]   2> 5869 T1676 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty1/tlog
[junit4:junit4]   2> 5869 T1676 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5869 T1676 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5872 T1677 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3540be79 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5874 T1676 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5874 T1676 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6742 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6743 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60002__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60002/_o"}
[junit4:junit4]   2> 6743 T1657 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 6743 T1657 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6782 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6782 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6782 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6876 T1676 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6876 T1676 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60002/_o collection:collection1 shard:shard1
[junit4:junit4]   2> 6877 T1676 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6892 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6893 T1676 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6894 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6904 T1676 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6904 T1676 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6905 T1676 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60002/_o/collection1/
[junit4:junit4]   2> 6905 T1676 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6905 T1676 oasc.SyncStrategy.syncToMe http://127.0.0.1:60002/_o/collection1/ has no replicas
[junit4:junit4]   2> 6905 T1676 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60002/_o/collection1/
[junit4:junit4]   2> 6906 T1676 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6916 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8286 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8306 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8306 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8306 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8351 T1676 oasc.ZkController.register We are http://127.0.0.1:60002/_o/collection1/ and leader is http://127.0.0.1:60002/_o/collection1/
[junit4:junit4]   2> 8351 T1676 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60002/_o
[junit4:junit4]   2> 8351 T1676 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8351 T1676 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8351 T1676 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8354 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8355 T1634 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8355 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8356 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8549 T1634 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8552 T1634 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60012
[junit4:junit4]   2> 8553 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8553 T1634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8554 T1634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915
[junit4:junit4]   2> 8554 T1634 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/solr.xml
[junit4:junit4]   2> 8555 T1634 oasc.CoreContainer.<init> New CoreContainer 1540094975
[junit4:junit4]   2> 8555 T1634 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/'
[junit4:junit4]   2> 8556 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/'
[junit4:junit4]   2> 8603 T1634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8604 T1634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8604 T1634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8605 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8605 T1634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8606 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8606 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8606 T1634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8607 T1634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8607 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8628 T1634 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8645 T1634 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59987/solr
[junit4:junit4]   2> 8646 T1634 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8646 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@455d23dd
[junit4:junit4]   2> 8648 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8648 T1687 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8648 T1687 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 8649 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60013
[junit4:junit4]   2> 8649 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60013
[junit4:junit4]   2> 8651 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0007 with negotiated timeout 20000 for client /140.211.11.196:60013
[junit4:junit4]   2> 8651 T1687 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0007, negotiated timeout = 20000
[junit4:junit4]   2> 8651 T1688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@455d23dd name:ZooKeeperConnection Watcher:127.0.0.1:59987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8651 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8652 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e0007
[junit4:junit4]   2> 8661 T1688 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8661 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60013 which had sessionid 0x13d97b3e71e0007
[junit4:junit4]   2> 8661 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e0007 closed
[junit4:junit4]   2> 8661 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8673 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a740c6b
[junit4:junit4]   2> 8674 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8674 T1689 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8674 T1689 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 8675 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60014
[junit4:junit4]   2> 8675 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60014
[junit4:junit4]   2> 8676 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0008 with negotiated timeout 20000 for client /140.211.11.196:60014
[junit4:junit4]   2> 8676 T1689 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0008, negotiated timeout = 20000
[junit4:junit4]   2> 8677 T1690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a740c6b name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8677 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8678 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8680 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8682 T1634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9685 T1634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60012__o
[junit4:junit4]   2> 9686 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e0008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60012__o Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60012__o
[junit4:junit4]   2> 9687 T1634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60012__o
[junit4:junit4]   2> 9690 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9691 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9691 T1675 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9691 T1690 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9691 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9693 T1656 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9693 T1662 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9706 T1691 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/collection1
[junit4:junit4]   2> 9706 T1691 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9707 T1691 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9707 T1691 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9708 T1691 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/collection1/'
[junit4:junit4]   2> 9709 T1691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9710 T1691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/collection1/lib/README' to classloader
[junit4:junit4]   2> 9766 T1691 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 9811 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9812 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60002__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60002/_o"}
[junit4:junit4]   2> 9824 T1691 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9844 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9845 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9845 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9845 T1691 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9845 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9851 T1691 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10445 T1691 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10455 T1691 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10459 T1691 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10473 T1691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10477 T1691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10481 T1691 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10482 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10482 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10483 T1691 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10484 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10484 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10484 T1691 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10484 T1691 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1364049790915/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2/
[junit4:junit4]   2> 10485 T1691 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@174aa60
[junit4:junit4]   2> 10485 T1691 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10486 T1691 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2 forceNew: false
[junit4:junit4]   2> 10486 T1691 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2/index/
[junit4:junit4]   2> 10486 T1691 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10488 T1691 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2/index forceNew: false
[junit4:junit4]   2> 10492 T1691 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10492 T1691 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10495 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10495 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10496 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10496 T1691 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10497 T1691 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10497 T1691 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10497 T1691 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10498 T1691 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10498 T1691 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10505 T1691 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10511 T1691 oass.SolrIndexSearcher.<init> Opening Searcher@5d36718c main
[junit4:junit4]   2> 10511 T1691 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2/tlog
[junit4:junit4]   2> 10512 T1691 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10512 T1691 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10516 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d36718c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10518 T1691 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10518 T1691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11349 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11350 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60012__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60012/_o"}
[junit4:junit4]   2> 11350 T1657 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11351 T1657 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11365 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11365 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11365 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11365 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11521 T1691 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11521 T1691 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60012/_o collection:collection1 shard:shard1
[junit4:junit4]   2> 11524 T1691 oasc.ZkController.register We are http://127.0.0.1:60012/_o/collection1/ and leader is http://127.0.0.1:60002/_o/collection1/
[junit4:junit4]   2> 11524 T1691 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60012/_o
[junit4:junit4]   2> 11525 T1691 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11525 T1691 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C110 name=collection1 org.apache.solr.core.SolrCore@385595bb url=http://127.0.0.1:60012/_o/collection1 node=127.0.0.1:60012__o C110_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60012__o, base_url=http://127.0.0.1:60012/_o}
[junit4:junit4]   2> 11526 T1693 C110 P60012 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11526 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11526 T1691 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11526 T1693 C110 P60012 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11527 T1693 C110 P60012 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11527 T1634 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 11528 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11528 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11538 T1693 C110 P60012 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11720 T1634 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11722 T1634 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60022
[junit4:junit4]   2> 11723 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11724 T1634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11724 T1634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088
[junit4:junit4]   2> 11724 T1634 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/solr.xml
[junit4:junit4]   2> 11725 T1634 oasc.CoreContainer.<init> New CoreContainer 93751661
[junit4:junit4]   2> 11725 T1634 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/'
[junit4:junit4]   2> 11726 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/'
[junit4:junit4]   2> 11773 T1634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 11774 T1634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11774 T1634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11775 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11775 T1634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11776 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11776 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11777 T1634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11777 T1634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11777 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11796 T1634 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11814 T1634 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59987/solr
[junit4:junit4]   2> 11815 T1634 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11815 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@fb43d0b
[junit4:junit4]   2> 11816 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11817 T1703 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11817 T1703 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 11818 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60023
[junit4:junit4]   2> 11818 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60023
[junit4:junit4]   2> 11820 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e0009 with negotiated timeout 20000 for client /140.211.11.196:60023
[junit4:junit4]   2> 11820 T1703 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e0009, negotiated timeout = 20000
[junit4:junit4]   2> 11820 T1704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fb43d0b name:ZooKeeperConnection Watcher:127.0.0.1:59987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11820 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11821 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e0009
[junit4:junit4]   2> 11829 T1704 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11829 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:60023 which had sessionid 0x13d97b3e71e0009
[junit4:junit4]   2> 11829 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e0009 closed
[junit4:junit4]   2> 11829 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 11839 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@427a269c
[junit4:junit4]   2> 11840 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11840 T1705 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11840 T1705 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 11840 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60024
[junit4:junit4]   2> 11841 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60024
[junit4:junit4]   2> 11842 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e000a with negotiated timeout 20000 for client /140.211.11.196:60024
[junit4:junit4]   2> 11842 T1705 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e000a, negotiated timeout = 20000
[junit4:junit4]   2> 11842 T1706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@427a269c name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11842 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11843 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e000a type:create cxid:0x1 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11845 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e000a type:create cxid:0x3 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11854 T1634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12857 T1634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60022__o
[junit4:junit4]   2> 12858 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e000a type:delete cxid:0xd zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60022__o Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60022__o
[junit4:junit4]   2> 12859 T1634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60022__o
[junit4:junit4]   2> 12862 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12862 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12862 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12863 T1706 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12863 T1675 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12863 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12864 T1656 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12864 T1662 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12864 T1690 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12872 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12872 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60012__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60012/_o"}
[junit4:junit4]   2> 12876 T1707 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/collection1
[junit4:junit4]   2> 12877 T1707 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12884 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12884 T1707 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12884 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12885 T1707 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12884 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12884 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12884 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12887 T1707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/collection1/'
[junit4:junit4]   2> 12888 T1707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/collection1/lib/README' to classloader
[junit4:junit4]   2> 12888 T1707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12936 T1707 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 12997 T1707 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13098 T1707 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13104 T1707 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13550 T1665 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=3&state=recovering&nodeName=127.0.0.1:60012__o&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002 
[junit4:junit4]   2> 13700 T1707 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13711 T1707 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13715 T1707 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13729 T1707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13734 T1707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13738 T1707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13739 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 13739 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 13740 T1707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13741 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 13741 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 13741 T1707 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 13741 T1707 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1364049794088/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3/
[junit4:junit4]   2> 13742 T1707 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@174aa60
[junit4:junit4]   2> 13742 T1707 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 13743 T1707 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3 forceNew: false
[junit4:junit4]   2> 13743 T1707 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3/index/
[junit4:junit4]   2> 13743 T1707 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13745 T1707 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3/index forceNew: false
[junit4:junit4]   2> 13754 T1707 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13755 T1707 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13757 T1707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13757 T1707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13758 T1707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13759 T1707 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13759 T1707 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13759 T1707 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13760 T1707 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13760 T1707 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13761 T1707 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13768 T1707 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13774 T1707 oass.SolrIndexSearcher.<init> Opening Searcher@cdcdbf7 main
[junit4:junit4]   2> 13775 T1707 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3/tlog
[junit4:junit4]   2> 13775 T1707 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13776 T1707 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13779 T1708 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cdcdbf7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13781 T1707 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13781 T1707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14389 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14390 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60022__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60022/_o"}
[junit4:junit4]   2> 14390 T1657 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14391 T1657 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14402 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14402 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14402 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14402 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14402 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14784 T1707 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 14784 T1707 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60022/_o collection:collection1 shard:shard1
[junit4:junit4]   2> 14789 T1707 oasc.ZkController.register We are http://127.0.0.1:60022/_o/collection1/ and leader is http://127.0.0.1:60002/_o/collection1/
[junit4:junit4]   2> 14789 T1707 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60022/_o
[junit4:junit4]   2> 14789 T1707 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 14789 T1707 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C111 name=collection1 org.apache.solr.core.SolrCore@450ddc63 url=http://127.0.0.1:60022/_o/collection1 node=127.0.0.1:60022__o C111_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60022__o, base_url=http://127.0.0.1:60022/_o}
[junit4:junit4]   2> 14790 T1709 C111 P60022 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 14791 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 14791 T1707 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14791 T1709 C111 P60022 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 14791 T1709 C111 P60022 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14792 T1634 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 14793 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 14793 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14797 T1709 C111 P60022 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14989 T1634 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 14992 T1634 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60845
[junit4:junit4]   2> 14992 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 14993 T1634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 14993 T1634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356
[junit4:junit4]   2> 14994 T1634 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/solr.xml
[junit4:junit4]   2> 14994 T1634 oasc.CoreContainer.<init> New CoreContainer 1049929458
[junit4:junit4]   2> 14995 T1634 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/'
[junit4:junit4]   2> 14995 T1634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/'
[junit4:junit4]   2> 15043 T1634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 15043 T1634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 15044 T1634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 15044 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 15045 T1634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 15045 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 15046 T1634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 15046 T1634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 15046 T1634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 15047 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 15068 T1634 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 15086 T1634 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59987/solr
[junit4:junit4]   2> 15086 T1634 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 15087 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e4b5008
[junit4:junit4]   2> 15088 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15088 T1719 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15088 T1719 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 15089 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:12743
[junit4:junit4]   2> 15089 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:12743
[junit4:junit4]   2> 15091 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e000b with negotiated timeout 20000 for client /140.211.11.196:12743
[junit4:junit4]   2> 15091 T1719 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e000b, negotiated timeout = 20000
[junit4:junit4]   2> 15091 T1720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e4b5008 name:ZooKeeperConnection Watcher:127.0.0.1:59987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15092 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15093 T1639 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d97b3e71e000b
[junit4:junit4]   2> 15122 T1720 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15122 T1636 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:12743 which had sessionid 0x13d97b3e71e000b
[junit4:junit4]   2> 15122 T1634 oaz.ZooKeeper.close Session: 0x13d97b3e71e000b closed
[junit4:junit4]   2> 15123 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 15134 T1634 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59987/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@50d8628f
[junit4:junit4]   2> 15135 T1634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15135 T1721 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:59987. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15136 T1721 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:59987, initiating session
[junit4:junit4]   2> 15136 T1636 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37193
[junit4:junit4]   2> 15136 T1636 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37193
[junit4:junit4]   2> 15137 T1638 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d97b3e71e000c with negotiated timeout 20000 for client /140.211.11.196:37193
[junit4:junit4]   2> 15137 T1721 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:59987, sessionid = 0x13d97b3e71e000c, negotiated timeout = 20000
[junit4:junit4]   2> 15137 T1722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50d8628f name:ZooKeeperConnection Watcher:127.0.0.1:59987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15138 T1634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15138 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e000c type:create cxid:0x1 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15140 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e000c type:create cxid:0x3 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15143 T1634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C110_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60012__o, base_url=http://127.0.0.1:60012/_o}
[junit4:junit4]   2> 15552 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60002/_o/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15552 T1693 C110 P60012 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60012/_o START replicas=[http://127.0.0.1:60002/_o/collection1/] nUpdates=100
[junit4:junit4]   2> 15552 T1693 C110 P60012 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15553 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15553 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15553 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15554 T1693 C110 P60012 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15554 T1693 C110 P60012 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60002/_o/collection1/. core=collection1
[junit4:junit4]   2> 15554 T1693 C110 P60012 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C112 name=collection1 org.apache.solr.core.SolrCore@1d24714a url=http://127.0.0.1:60002/_o/collection1 node=127.0.0.1:60002__o C112_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60002__o, base_url=http://127.0.0.1:60002/_o, leader=true}
[junit4:junit4]   2> 15563 T1667 C112 P60002 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15570 T1668 C112 P60002 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 15573 T1668 C112 P60002 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15574 T1668 C112 P60002 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15577 T1668 C112 P60002 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15577 T1668 C112 P60002 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15578 T1668 C112 P60002 oass.SolrIndexSearcher.<init> Opening Searcher@11a2d231 realtime
[junit4:junit4]   2> 15578 T1668 C112 P60002 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15579 T1668 C112 P60002 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4]   2> 15580 T1693 C110 P60012 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15580 T1693 C110 P60012 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 15581 T1669 C112 P60002 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15582 T1669 C112 P60002 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15582 T1693 C110 P60012 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 15582 T1693 C110 P60012 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 15583 T1693 C110 P60012 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 15585 T1669 C112 P60002 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 15586 T1693 C110 P60012 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 15587 T1693 C110 P60012 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty2/index.20130323174318132 forceNew: false
[junit4:junit4]   2> 15587 T1693 C110 P60012 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b348009 lockFactory=org.apache.lucene.store.NativeFSLockFactory@8b1e8aa) fullCopy=false
[junit4:junit4]   2> 15590 T1669 C112 P60002 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 15591 T1693 C110 P60012 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 15593 T1693 C110 P60012 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 15593 T1693 C110 P60012 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 15596 T1693 C110 P60012 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15596 T1693 C110 P60012 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15597 T1693 C110 P60012 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 15597 T1693 C110 P60012 oass.SolrIndexSearcher.<init> Opening Searcher@23abe9f6 main
[junit4:junit4]   2> 15598 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23abe9f6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 15598 T1693 C110 P60012 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 15598 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 15599 T1693 C110 P60012 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15599 T1693 C110 P60012 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15600 T1693 C110 P60012 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 15906 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15907 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60022__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60022/_o"}
[junit4:junit4]   2> 15911 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60012__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60012/_o"}
[junit4:junit4]   2> 15915 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15915 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15915 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15915 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15915 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15915 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16146 T1634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60845__o
[junit4:junit4]   2> 16147 T1639 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d97b3e71e000c type:delete cxid:0xf zxid:0x9c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60845__o Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60845__o
[junit4:junit4]   2> 16148 T1634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60845__o
[junit4:junit4]   2> 16150 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16150 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16150 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16150 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16150 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16151 T1675 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16151 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16152 T1706 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16152 T1662 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16152 T1690 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16160 T1722 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16160 T1656 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16168 T1725 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/collection1
[junit4:junit4]   2> 16169 T1725 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16169 T1725 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16169 T1725 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16171 T1725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/collection1/'
[junit4:junit4]   2> 16172 T1725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16172 T1725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/collection1/lib/README' to classloader
[junit4:junit4]   2> 16239 T1725 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 16293 T1725 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16394 T1725 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 16400 T1725 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 16813 T1666 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&state=recovering&nodeName=127.0.0.1:60022__o&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002 
[junit4:junit4]   2> 16991 T1725 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17002 T1725 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17007 T1725 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17020 T1725 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17024 T1725 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17029 T1725 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17030 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17030 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17030 T1725 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17031 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17031 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17032 T1725 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17032 T1725 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1364049797356/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/
[junit4:junit4]   2> 17032 T1725 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@174aa60
[junit4:junit4]   2> 17033 T1725 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17033 T1725 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4 forceNew: false
[junit4:junit4]   2> 17034 T1725 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index/
[junit4:junit4]   2> 17034 T1725 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17035 T1725 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index forceNew: false
[junit4:junit4]   2> 17068 T1725 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17068 T1725 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17070 T1725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17071 T1725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17071 T1725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17072 T1725 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17072 T1725 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17073 T1725 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17073 T1725 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17074 T1725 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17074 T1725 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17081 T1725 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17088 T1725 oass.SolrIndexSearcher.<init> Opening Searcher@7321d6de main
[junit4:junit4]   2> 17088 T1725 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/tlog
[junit4:junit4]   2> 17089 T1725 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17089 T1725 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17093 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7321d6de main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17095 T1725 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17095 T1725 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17421 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17422 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60845__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60845/_o"}
[junit4:junit4]   2> 17422 T1657 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 17422 T1657 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 17435 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17435 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17435 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17435 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17435 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17435 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18097 T1725 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18097 T1725 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60845/_o collection:collection1 shard:shard1
[junit4:junit4]   2> 18100 T1725 oasc.ZkController.register We are http://127.0.0.1:60845/_o/collection1/ and leader is http://127.0.0.1:60002/_o/collection1/
[junit4:junit4]   2> 18100 T1725 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60845/_o
[junit4:junit4]   2> 18101 T1725 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 18101 T1725 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C113 name=collection1 org.apache.solr.core.SolrCore@f1262d3 url=http://127.0.0.1:60845/_o/collection1 node=127.0.0.1:60845__o C113_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60845__o, base_url=http://127.0.0.1:60845/_o}
[junit4:junit4]   2> 18102 T1727 C113 P60845 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 18102 T1725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18103 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 18103 T1727 C113 P60845 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 18103 T1727 C113 P60845 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18103 T1634 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 18104 T1634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 18104 T1634 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18105 T1727 C113 P60845 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18120 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18121 T1634 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 18121 T1634 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 18122 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C111_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60022__o, base_url=http://127.0.0.1:60022/_o}
[junit4:junit4]   2> 18815 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60002/_o/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18815 T1709 C111 P60022 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60022/_o START replicas=[http://127.0.0.1:60002/_o/collection1/] nUpdates=100
[junit4:junit4]   2> 18815 T1709 C111 P60022 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18816 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18816 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18816 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18816 T1709 C111 P60022 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18816 T1709 C111 P60022 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60002/_o/collection1/. core=collection1
[junit4:junit4]   2> 18816 T1709 C111 P60022 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18818 T1667 C112 P60002 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18826 T1671 C112 P60002 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 18839 T1671 C112 P60002 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18839 T1671 C112 P60002 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18840 T1671 C112 P60002 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18840 T1671 C112 P60002 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4]   2> 18841 T1709 C111 P60022 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18841 T1709 C111 P60022 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18843 T1669 C112 P60002 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18844 T1709 C111 P60022 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 18844 T1709 C111 P60022 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18844 T1709 C111 P60022 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18846 T1669 C112 P60002 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18847 T1709 C111 P60022 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18848 T1709 C111 P60022 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty3/index.20130323174321393 forceNew: false
[junit4:junit4]   2> 18849 T1709 C111 P60022 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3085b3ad lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b627113) fullCopy=false
[junit4:junit4]   2> 18851 T1669 C112 P60002 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   2> 18852 T1709 C111 P60022 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18853 T1709 C111 P60022 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 18854 T1709 C111 P60022 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 18857 T1709 C111 P60022 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18857 T1709 C111 P60022 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18858 T1709 C111 P60022 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 18858 T1709 C111 P60022 oass.SolrIndexSearcher.<init> Opening Searcher@528b2653 main
[junit4:junit4]   2> 18859 T1708 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@528b2653 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 18859 T1709 C111 P60022 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 18859 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 18860 T1709 C111 P60022 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 18860 T1709 C111 P60022 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18861 T1709 C111 P60022 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 18939 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18940 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60845__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60845/_o"}
[junit4:junit4]   2> 18944 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60022__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60022/_o"}
[junit4:junit4]   2> 18955 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18956 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18956 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18956 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18956 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18955 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19122 T1670 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=5&state=recovering&nodeName=127.0.0.1:60845__o&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 19124 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20126 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C113_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60845__o, base_url=http://127.0.0.1:60845/_o}
[junit4:junit4]   2> 21123 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60002/_o/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 21123 T1727 C113 P60845 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60845/_o START replicas=[http://127.0.0.1:60002/_o/collection1/] nUpdates=100
[junit4:junit4]   2> 21124 T1727 C113 P60845 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 21124 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 21124 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 21124 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 21124 T1727 C113 P60845 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 21124 T1727 C113 P60845 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60002/_o/collection1/. core=collection1
[junit4:junit4]   2> 21125 T1727 C113 P60845 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 21126 T1667 C112 P60002 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 21128 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21140 T1665 C112 P60002 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 21143 T1665 C112 P60002 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 21143 T1665 C112 P60002 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 21144 T1665 C112 P60002 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 21144 T1665 C112 P60002 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4]   2> 21145 T1727 C113 P60845 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 21145 T1727 C113 P60845 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 21147 T1669 C112 P60002 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 21148 T1727 C113 P60845 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 21148 T1727 C113 P60845 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 21148 T1727 C113 P60845 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 21150 T1669 C112 P60002 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0 
[junit4:junit4]   2> 21151 T1727 C113 P60845 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 21152 T1727 C113 P60845 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index.20130323174323697 forceNew: false
[junit4:junit4]   2> 21153 T1727 C113 P60845 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cb1227e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f29e045) fullCopy=false
[junit4:junit4]   2> 21155 T1669 C112 P60002 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 21156 T1727 C113 P60845 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 21163 T1727 C113 P60845 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 21163 T1727 C113 P60845 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 21166 T1727 C113 P60845 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 21167 T1727 C113 P60845 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 21167 T1727 C113 P60845 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 21167 T1727 C113 P60845 oass.SolrIndexSearcher.<init> Opening Searcher@137befbe main
[junit4:junit4]   2> 21168 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@137befbe main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 21169 T1727 C113 P60845 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 21169 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 21169 T1727 C113 P60845 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 21169 T1727 C113 P60845 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 21171 T1727 C113 P60845 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 21970 T1657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21971 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60845__o",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60845/_o"}
[junit4:junit4]   2> 21985 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21985 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21985 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21985 T1662 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21985 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21985 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22130 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22131 T1634 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C114 name=collection1 org.apache.solr.core.SolrCore@6bfabcee url=http://127.0.0.1:59993/_o/collection1 node=127.0.0.1:59993__o C114_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:59993__o, base_url=http://127.0.0.1:59993/_o, leader=true}
[junit4:junit4]   2> 22141 T1646 C114 P59993 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22145 T1646 C114 P59993 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115483tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@319f8018),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22145 T1646 C114 P59993 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22151 T1646 C114 P59993 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115483tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@319f8018),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115483tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@319f8018),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22151 T1646 C114 P59993 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22153 T1646 C114 P59993 oass.SolrIndexSearcher.<init> Opening Searcher@695aed8 main
[junit4:junit4]   2> 22153 T1646 C114 P59993 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22154 T1660 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@695aed8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 22155 T1646 C114 P59993 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4]   2> 22164 T1668 C112 P60002 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22167 T1668 C112 P60002 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 22168 T1668 C112 P60002 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 22168 T1668 C112 P60002 oass.SolrIndexSearcher.<init> Opening Searcher@2a7df2f3 main
[junit4:junit4]   2> 22169 T1668 C112 P60002 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22169 T1677 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a7df2f3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22170 T1668 C112 P60002 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60012/_o/collection1/, StdNode: http://127.0.0.1:60022/_o/collection1/, StdNode: http://127.0.0.1:60845/_o/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2>  C113_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60845__o, base_url=http://127.0.0.1:60845/_o}
[junit4:junit4]   2> 22184 T1712 C113 P60845 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C110_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60012__o, base_url=http://127.0.0.1:60012/_o}
[junit4:junit4]   2> 22188 T1680 C110 P60012 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C111_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60022__o, base_url=http://127.0.0.1:60022/_o}
[junit4:junit4]   2> 22188 T1696 C111 P60022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22188 T1712 C113 P60845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 22189 T1712 C113 P60845 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 22190 T1712 C113 P60845 oass.SolrIndexSearcher.<init> Opening Searcher@745e8bf main
[junit4:junit4]   2> 22190 T1712 C113 P60845 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22191 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@745e8bf main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 22191 T1712 C113 P60845 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 22199 T1680 C110 P60012 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 22199 T1696 C111 P60022 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22200 T1680 C110 P60012 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 22200 T1696 C111 P60022 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22201 T1696 C111 P60022 oass.SolrIndexSearcher.<init> Opening Searcher@302a4b21 main
[junit4:junit4]   2> 22201 T1680 C110 P60012 oass.SolrIndexSearcher.<init> Opening Searcher@302a4b21 main
[junit4:junit4]   2> 22202 T1696 C111 P60022 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22202 T1680 C110 P60012 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22202 T1708 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1118)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:433)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:421)
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:541)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:138)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1766)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1643)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 
[junit4:junit4]   2> 22202 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@302a4b21 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22203 T1680 C110 P60012 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4]   2> 22203 T1708 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@302a4b21 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 22203 T1696 C111 P60022 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4]   2> 22204 T1668 C112 P60002 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 40
[junit4:junit4]   2> 22205 T1634 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22207 T1666 C112 P60002 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 22209 T1681 C110 P60012 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 22211 T1697 C111 P60022 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 22212 T1713 C113 P60845 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 24218 T1646 C114 P59993 oass.SolrIndexSearcher.<init> Opening Searcher@4b0e2694 realtime
[junit4:junit4]   2> 24218 T1646 C114 P59993 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1430309890175270912)} 0 2
[junit4:junit4]   2> 24225 T1712 C113 P60845 /update {update.distrib=FROMLEADER&_version_=-1430309890180513792&update.from=http://127.0.0.1:60002/_o/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1430309890180513792)} 0 1
[junit4:junit4]   2> 24226 T1680 C110 P60012 /update {update.distrib=FROMLEADER&_version_=-1430309890180513792&update.from=http://127.0.0.1:60002/_o/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1430309890180513792)} 0 2
[junit4:junit4]   2> 24226 T1696 C111 P60022 /update {update.distrib=FROMLEADER&_version_=-1430309890180513792&update.from=http://127.0.0.1:60002/_o/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1430309890180513792)} 0 2
[junit4:junit4]   2> 24226 T1668 C112 P60002 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1430309890180513792)} 0 5
[junit4:junit4]   2> 24231 T1646 C114 P59993 /update {wt=javabin&version=2} {add=[0 (1430309890188902400)]} 0 2
[junit4:junit4]   2> 24240 T1712 C113 P60845 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1430309890194145280)]} 0 2
[junit4:junit4]   2> 24241 T1680 C110 P60012 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1430309890194145280)]} 0 3
[junit4:junit4]   2> 24241 T1696 C111 P60022 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1430309890194145280)]} 0 3
[junit4:junit4]   2> 24242 T1668 C112 P60002 /update {wt=javabin&version=2} {add=[0 (1430309890194145280)]} 0 8
[junit4:junit4]   2> 24245 T1646 C114 P59993 /update {wt=javabin&version=2} {add=[1 (1430309890204631040)]} 0 1
[junit4:junit4]   2> 24251 T1712 C113 P60845 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1430309890207776768)]} 0 1
[junit4:junit4]   2> 24251 T1696 C111 P60022 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1430309890207776768)]} 0 1
[junit4:junit4]   2> 24251 T1680 C110 P60012 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1430309890207776768)]} 0 1
[junit4:junit4]   2> 24252 T1668 C112 P60002 /update {wt=javabin&version=2} {add=[1 (1430309890207776768)]} 0 5
[junit4:junit4]   2> 24255 T1646 C114 P59993 /update {wt=javabin&version=2} {add=[2 (1430309890215116800)]} 0 1
[junit4:junit4]   2> 24261 T1712 C113 P60845 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1430309890218262528)]} 0 1
[junit4:junit4]   2> 24261 T1696 C111 P60022 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1430309890218262528)]} 0 1
[junit4:junit4]   2> 24261 T1668 C112 P60002 /update {test.distrib.skip.servers=http://127.0.0.1:60012/_o/collection1/&wt=javabin&version=2} {add=[2 (1430309890218262528)]} 0 4
[junit4:junit4]   2> 24265 T1646 C114 P59993 /update {wt=javabin&version=2} {add=[3 (1430309890225602560)]} 0 1
[junit4:junit4]   2> 24271 T1712 C113 P60845 /update {distrib.from=http://127.0.0.1:60002/_o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1430309890228748288)]} 0 1
[junit4:junit4]   2> 24271 T1668 C112 P60002 /update {test.distrib.skip.servers=http://127.0.0.1:60012/_o/collection1/&test.distrib.skip.servers=http://127.0.0.1:60022/_o/collection1/&wt=javabin&version=2} {add=[3 (1430309890228748288)]} 0 4
[junit4:junit4]   2> 24274 T1646 C114 P59993 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24385 T1646 C114 P59993 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115483tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@319f8018),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115483tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@319f8018),segFN=segments_3,generation=3,filenames=[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4]   2> 24386 T1646 C114 P59993 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4]   2> 24394 T1646 C114 P59993 oass.SolrIndexSearcher.<init> Opening Searcher@45bbbb4a main
[junit4:junit4]   2> 24395 T1646 C114 P59993 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24395 T1660 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45bbbb4a main{StandardDirectoryReader(segments_3:3:nrt _0(4.2.1):C4)}
[junit4:junit4]   2> 24396 T1646 C114 P59993 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 122
[junit4:junit4]   2> 24398 T1668 C112 P60002 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24496 T1668 C112 P60002 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115484tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@791ea302),segFN=segments_6,generation=6,filenames=[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, _0_Asserting_0.pos, segments_6, _0.fdt]
[junit4:junit4]   2> 24497 T1668 C112 P60002 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, _0_Asserting_0.pos, segments_6, _0.fdt]
[junit4:junit4]   2> 24506 T1668 C112 P60002 oass.SolrIndexSearcher.<init> Opening Searcher@d2287d3 main
[junit4:junit4]   2> 24506 T1668 C112 P60002 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24507 T1677 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d2287d3 main{StandardDirectoryReader(segments_6:3:nrt _0(4.2.1):C4)}
[junit4:junit4]   2> 24507 T1668 C112 P60002 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60012/_o/collection1/, StdNode: http://127.0.0.1:60022/_o/collection1/, StdNode: http://127.0.0.1:60845/_o/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 24510 T1712 C113 P60845 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24510 T1680 C110 P60012 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24510 T1696 C111 P60022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24629 T1696 C111 P60022 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115486tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f0057d),segFN=segments_5,generation=5,filenames=[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, segments_5, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4]   2> 24630 T1712 C113 P60845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115487tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb1cad1),segFN=segments_6,generation=6,filenames=[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, _0_Asserting_0.pos, segments_6, _0.fdt]
[junit4:junit4]   2> 24630 T1696 C111 P60022 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, segments_5, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4]   2> 24630 T1712 C113 P60845 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_Asserting_0.doc, _0_MockVariableIntBlock_0.tii, _0_NestedPulsing_0.doc, _0.fnm, _0_Lucene41WithOrds_0.doc, _0.nvm, _0_MockVariableIntBlock_0.frq, _0.fdx, _0_Asserting_0.pos, segments_6, _0.fdt]
[junit4:junit4]   2> 24631 T1680 C110 P60012 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build/solr-core/test/J0/index1546115485tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@4fb370a7),segFN=segments_4,generation=4,filenames=[_0_Lucene41WithOrds_0.tib, _0_Asserting_0.tim, _0_Asserting_0.tip, _0_MockVariableIntBlock_0.doc, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockVariableIntBlock_0.skp, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_NestedPulsing_0.pos, _0_MockVariableIntBlock_0.p

[...truncated too long message...]

.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 140653 T1634 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 169323 T1722 oasu.PeerSync.handleResponse WARNING PeerSync: core=collection1 url=http://127.0.0.1:60845/_o  couldn't connect to http://127.0.0.1:60022/_o/collection1/, counting as success
[junit4:junit4]   2> 169323 T1722 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60845/_o DONE. sync succeeded
[junit4:junit4]   2> 169323 T1722 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4]   2> 169324 T1722 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4]   2> 169325 T1722 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@f1262d3
[junit4:junit4]   2> 169326 T1722 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=10,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=305,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 169326 T1722 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 169327 T1722 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 169327 T1722 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 169327 T1722 C113 P60845 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/tlog/tlog.0000000000000000005 refcount=1}
[junit4:junit4]   2> 169330 T1722 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 169331 T1722 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index
[junit4:junit4]   2> 169331 T1722 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index
[junit4:junit4]   2> 169421 T1722 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index.20130323174323697
[junit4:junit4]   2> 169421 T1722 oasc.CachingDirectoryFactory.closeDirectory Removing directory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index.20130323174323697
[junit4:junit4]   2> 169421 T1722 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4/index.20130323174323697
[junit4:junit4]   2> 169421 T1722 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4
[junit4:junit4]   2> 169421 T1722 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1364049782551/jetty4
[junit4:junit4]   2> 169422 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 169422 T1722 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 169422 T1722 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 169422 T1722 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 169423 T1722 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=NestedPulsing), text=PostingsFormat(name=Asserting), _version_=MockVariableIntBlock(baseBlockSize=14), rnd_b=PostingsFormat(name=Lucene41WithOrds), intDefault=MockVariableIntBlock(baseBlockSize=14), id=PostingsFormat(name=Lucene41WithOrds), timestamp=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=NestedPulsing), range_facet_sl=PostingsFormat(name=Lucene41WithOrds), range_facet_si=PostingsFormat(name=NestedPulsing), other_tl1=MockVariableIntBlock(baseBlockSize=14), multiDefault=PostingsFormat(name=NestedPulsing), a_si=MockVariableIntBlock(baseBlockSize=14)}, docValues:{}, sim=DefaultSimilarity, locale=es_CL, timezone=Africa/Djibouti
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=3,free=43087688,total=445382656
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestPropInjectDefaults, TestLRUCache, FieldMutatingUpdateProcessorTest, TestQueryUtils, ResourceLoaderTest, PluginInfoTest, LukeRequestHandlerTest, JsonLoaderTest, TestCollationField, TestCollationKeyRangeQueries, RAMDirectoryFactoryTest, RecoveryZkTest, BadComponentTest, XmlUpdateRequestHandlerTest, TestXIncludeConfig, TestPhraseSuggestions, UUIDFieldTest, TestTrie, SolrIndexSplitterTest, TestBadConfig, TestSearchPerf, TestDocSet, StatsComponentTest, TestIndexingPerformance, SolrInfoMBeanTest, SpellingQueryConverterTest, DirectSolrConnectionTest, TestWriterPerf, TestFuzzyAnalyzedSuggestions, QueryElevationComponentTest, PathHierarchyTokenizerFactoryTest, SynonymTokenizerTest, TestSurroundQueryParser, ShardRoutingCustomTest, DateFieldTest, DocumentAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, TestLFUCache, ShowFileRequestHandlerTest, TestExtendedDismaxParser, TestCopyFieldCollectionResource, TestMultiCoreConfBootstrap, SearchHandlerTest, SchemaVersionSpecificBehaviorTest, TestOmitPositions, TestDistributedSearch, SpellCheckCollatorTest, TestArbitraryIndexDir, SystemInfoHandlerTest, ResponseLogComponentTest, TestSolrDeletionPolicy2, SolrRequestParserTest, TestFiltering, TestSolrCoreProperties, TestSweetSpotSimilarityFactory, LeaderElectionTest, TestAnalyzedSuggestions, AlternateDirectoryTest, RequestHandlersTest, TestFieldResource, TestSolrIndexConfig, TestCSVResponseWriter, UnloadDistributedZkTest, LegacyHTMLStripCharFilterTest, BasicDistributedZkTest, BasicDistributedZk2Test, SyncSliceTest]
[junit4:junit4] Completed on J0 in 169.71s, 1 test, 1 failure <<< FAILURES!

[...truncated 403 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.2.1-Java6/lucene/common-build.xml:877: There were test failures: 269 suites, 1134 tests, 1 failure, 23 ignored (4 assumptions)

Total time: 45 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure