You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/02/02 09:25:13 UTC

[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1301 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1301/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 should have just been set up to be inconsistent - but it's still consistent

Stack Trace:
java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
	at __randomizedtesting.SeedInfo.seed([474A1B68E474A41A:C6AC9570932BC426]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8679 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T1882 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_f/
[junit4:junit4]   2> 5 T1882 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1359793333857
[junit4:junit4]   2> 7 T1882 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T1883 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 12 T1883 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 12 T1883 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 13 T1883 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 13 T1883 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 14 T1883 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T1882 oasc.ZkTestServer.run start zk server on port:28621
[junit4:junit4]   2> 108 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c05bbd1
[junit4:junit4]   2> 109 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 110 T1888 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 110 T1888 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 111 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28622
[junit4:junit4]   2> 111 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28622
[junit4:junit4]   2> 111 T1886 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 114 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0000 with negotiated timeout 10000 for client /140.211.11.196:28622
[junit4:junit4]   2> 114 T1888 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0000, negotiated timeout = 10000
[junit4:junit4]   2> 114 T1889 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c05bbd1 name:ZooKeeperConnection Watcher:127.0.0.1:28621 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 115 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 115 T1882 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 118 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b0000
[junit4:junit4]   2> 126 T1889 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 126 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28622 which had sessionid 0x13c99ffa66b0000
[junit4:junit4]   2> 126 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b0000 closed
[junit4:junit4]   2> 127 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c146e30
[junit4:junit4]   2> 127 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 128 T1890 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 128 T1890 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 128 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28623
[junit4:junit4]   2> 129 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28623
[junit4:junit4]   2> 137 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0001 with negotiated timeout 10000 for client /140.211.11.196:28623
[junit4:junit4]   2> 137 T1890 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0001, negotiated timeout = 10000
[junit4:junit4]   2> 137 T1891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c146e30 name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 137 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 138 T1882 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 142 T1882 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 145 T1882 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 147 T1882 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 150 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 151 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 169 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 170 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 274 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 275 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 278 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 279 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 289 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 290 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 293 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 294 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 296 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 297 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 300 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 301 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 304 T1882 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 304 T1882 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 307 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b0001
[junit4:junit4]   2> 314 T1891 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 314 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28623 which had sessionid 0x13c99ffa66b0001
[junit4:junit4]   2> 314 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b0001 closed
[junit4:junit4]   2> 474 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 477 T1882 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28624
[junit4:junit4]   2> 478 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 478 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 479 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166
[junit4:junit4]   2> 479 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/solr.xml
[junit4:junit4]   2> 480 T1882 oasc.CoreContainer.<init> New CoreContainer 869460229
[junit4:junit4]   2> 480 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/'
[junit4:junit4]   2> 481 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/'
[junit4:junit4]   2> 522 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 523 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 523 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 524 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 524 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 524 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 525 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 525 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 526 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 526 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 545 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 562 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:28621/solr
[junit4:junit4]   2> 563 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 563 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@33579950
[junit4:junit4]   2> 564 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 565 T1901 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 565 T1901 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 566 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28625
[junit4:junit4]   2> 566 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28625
[junit4:junit4]   2> 568 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0002 with negotiated timeout 20000 for client /140.211.11.196:28625
[junit4:junit4]   2> 568 T1901 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0002, negotiated timeout = 20000
[junit4:junit4]   2> 568 T1902 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33579950 name:ZooKeeperConnection Watcher:127.0.0.1:28621 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 568 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 569 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b0002
[junit4:junit4]   2> 570 T1902 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 570 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28625 which had sessionid 0x13c99ffa66b0002
[junit4:junit4]   2> 570 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b0002 closed
[junit4:junit4]   2> 571 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 580 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@396957cc
[junit4:junit4]   2> 581 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 581 T1903 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 582 T1903 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 582 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28626
[junit4:junit4]   2> 582 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28626
[junit4:junit4]   2> 583 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0003 with negotiated timeout 20000 for client /140.211.11.196:28626
[junit4:junit4]   2> 583 T1903 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0003, negotiated timeout = 20000
[junit4:junit4]   2> 584 T1904 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@396957cc name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 584 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 586 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 587 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 596 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28624__f
[junit4:junit4]   2> 596 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:28624__f Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:28624__f
[junit4:junit4]   2> 597 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28624__f
[junit4:junit4]   2> 600 T1882 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 613 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 614 T1882 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 616 T1882 oasc.Overseer.start Overseer (id=89115415928307715-127.0.0.1:28624__f-n_0000000000) starting
[junit4:junit4]   2> 617 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 618 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 627 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 628 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 629 T1906 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 630 T1882 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 643 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 645 T1905 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 650 T1907 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/collection1
[junit4:junit4]   2> 650 T1907 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 651 T1907 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 651 T1907 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 652 T1907 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/collection1/'
[junit4:junit4]   2> 653 T1907 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/collection1/lib/README' to classloader
[junit4:junit4]   2> 654 T1907 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 704 T1907 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 774 T1907 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 875 T1907 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 881 T1907 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1482 T1907 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1493 T1907 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1497 T1907 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1509 T1907 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1514 T1907 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1518 T1907 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1519 T1907 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1520 T1907 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359793334166/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data/
[junit4:junit4]   2> 1520 T1907 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e097617
[junit4:junit4]   2> 1521 T1907 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1555 T1907 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data forceNew:false
[junit4:junit4]   2> 1556 T1907 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data
[junit4:junit4]   2> 1556 T1907 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data/index/
[junit4:junit4]   2> 1557 T1907 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1558 T1907 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data/index forceNew:false
[junit4:junit4]   2> 1566 T1907 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@33c2b8a4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1566 T1907 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1567 T1907 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data/index
[junit4:junit4]   2> 1567 T1907 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1569 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1569 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1570 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1570 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1571 T1907 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1571 T1907 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1571 T1907 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1572 T1907 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1572 T1907 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1572 T1907 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1573 T1907 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1573 T1907 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1574 T1907 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1574 T1907 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1574 T1907 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1575 T1907 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1575 T1907 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1575 T1907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1576 T1907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1576 T1907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1577 T1907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1577 T1907 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1577 T1907 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1578 T1907 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1578 T1907 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1579 T1907 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1586 T1907 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1591 T1907 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1592 T1907 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1595 T1907 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/control/data
[junit4:junit4]   2> 1596 T1907 oass.SolrIndexSearcher.<init> Opening Searcher@2967d2b4 main
[junit4:junit4]   2> 1598 T1907 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1598 T1907 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1598 T1907 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1606 T1907 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1670 T1908 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2967d2b4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1674 T1907 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1674 T1907 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1675 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2148 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2149 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28624__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28624/_f"}
[junit4:junit4]   2> 2149 T1905 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2149 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2150 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2170 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2688 T1907 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2688 T1907 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28624/_f collection:control_collection shard:shard1
[junit4:junit4]   2> 2689 T1907 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2714 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2724 T1907 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2725 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2749 T1907 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2749 T1907 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2749 T1907 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28624/_f/collection1/
[junit4:junit4]   2> 2749 T1907 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2750 T1907 oasc.SyncStrategy.syncToMe http://127.0.0.1:28624/_f/collection1/ has no replicas
[junit4:junit4]   2> 2750 T1907 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28624/_f/collection1/
[junit4:junit4]   2> 2750 T1907 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2767 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3674 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3719 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3753 T1907 oasc.ZkController.register We are http://127.0.0.1:28624/_f/collection1/ and leader is http://127.0.0.1:28624/_f/collection1/
[junit4:junit4]   2> 3753 T1907 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28624/_f
[junit4:junit4]   2> 3753 T1907 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3753 T1907 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3753 T1907 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3755 T1907 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3756 T1882 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3757 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3757 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3770 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3778 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e144c38
[junit4:junit4]   2> 3779 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3780 T1909 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3780 T1909 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 3780 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28652
[junit4:junit4]   2> 3781 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28652
[junit4:junit4]   2> 3782 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0004 with negotiated timeout 10000 for client /140.211.11.196:28652
[junit4:junit4]   2> 3782 T1909 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0004, negotiated timeout = 10000
[junit4:junit4]   2> 3782 T1910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e144c38 name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3783 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3784 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3786 T1882 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3946 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3949 T1882 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28653
[junit4:junit4]   2> 3949 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3950 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3950 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637
[junit4:junit4]   2> 3951 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/solr.xml
[junit4:junit4]   2> 3951 T1882 oasc.CoreContainer.<init> New CoreContainer 1102158838
[junit4:junit4]   2> 3952 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/'
[junit4:junit4]   2> 3952 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/'
[junit4:junit4]   2> 3993 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 3994 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3994 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3995 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3995 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3995 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3996 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3996 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3997 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3997 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4015 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4033 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:28621/solr
[junit4:junit4]   2> 4034 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4034 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5dd1b545
[junit4:junit4]   2> 4035 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4036 T1920 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4037 T1920 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 4037 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28654
[junit4:junit4]   2> 4037 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28654
[junit4:junit4]   2> 4039 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0005 with negotiated timeout 20000 for client /140.211.11.196:28654
[junit4:junit4]   2> 4039 T1920 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0005, negotiated timeout = 20000
[junit4:junit4]   2> 4039 T1921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dd1b545 name:ZooKeeperConnection Watcher:127.0.0.1:28621 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4040 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4041 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b0005
[junit4:junit4]   2> 4042 T1921 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4042 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28654 which had sessionid 0x13c99ffa66b0005
[junit4:junit4]   2> 4042 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b0005 closed
[junit4:junit4]   2> 4043 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 4052 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4774ddcf
[junit4:junit4]   2> 4053 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4053 T1922 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4054 T1922 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 4054 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28655
[junit4:junit4]   2> 4054 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28655
[junit4:junit4]   2> 4056 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0006 with negotiated timeout 20000 for client /140.211.11.196:28655
[junit4:junit4]   2> 4056 T1922 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0006, negotiated timeout = 20000
[junit4:junit4]   2> 4056 T1923 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4774ddcf name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4056 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4057 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4058 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4068 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28653__f
[junit4:junit4]   2> 4069 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:28653__f Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:28653__f
[junit4:junit4]   2> 4070 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28653__f
[junit4:junit4]   2> 4073 T1904 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4073 T1910 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4073 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4080 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4087 T1924 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/collection1
[junit4:junit4]   2> 4087 T1924 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4088 T1924 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4088 T1924 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4089 T1924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/collection1/'
[junit4:junit4]   2> 4090 T1924 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/collection1/lib/README' to classloader
[junit4:junit4]   2> 4091 T1924 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4141 T1924 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 4211 T1924 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4312 T1924 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4318 T1924 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4913 T1924 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4924 T1924 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4928 T1924 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4942 T1924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4947 T1924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4951 T1924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4952 T1924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4953 T1924 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359793337637/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/
[junit4:junit4]   2> 4953 T1924 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e097617
[junit4:junit4]   2> 4954 T1924 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 4955 T1924 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1 forceNew:false
[junit4:junit4]   2> 4955 T1924 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 4956 T1924 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index/
[junit4:junit4]   2> 4956 T1924 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4957 T1924 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index forceNew:false
[junit4:junit4]   2> 4963 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4964 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4965 T1924 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index
[junit4:junit4]   2> 4965 T1924 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4967 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4967 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4967 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4968 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4968 T1924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4968 T1924 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4969 T1924 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4969 T1924 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4970 T1924 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4970 T1924 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4971 T1924 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4971 T1924 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4972 T1924 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4972 T1924 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4972 T1924 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4973 T1924 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4973 T1924 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4974 T1924 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4974 T1924 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4975 T1924 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4975 T1924 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4976 T1924 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4976 T1924 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4977 T1924 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4977 T1924 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4978 T1924 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4985 T1924 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4989 T1924 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4990 T1924 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4992 T1924 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 4994 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@3229e1cf main
[junit4:junit4]   2> 4995 T1924 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4995 T1924 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4996 T1924 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5003 T1924 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5062 T1925 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3229e1cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5066 T1924 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5067 T1924 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5232 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5233 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28624__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28624/_f"}
[junit4:junit4]   2> 5236 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28653__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28653/_f"}
[junit4:junit4]   2> 5237 T1905 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 5237 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5247 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5247 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5247 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6069 T1924 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6069 T1924 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28653/_f collection:collection1 shard:shard1
[junit4:junit4]   2> 6070 T1924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6117 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6117 T1924 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6118 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6128 T1924 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6128 T1924 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6129 T1924 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28653/_f/collection1/
[junit4:junit4]   2> 6129 T1924 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6129 T1924 oasc.SyncStrategy.syncToMe http://127.0.0.1:28653/_f/collection1/ has no replicas
[junit4:junit4]   2> 6129 T1924 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28653/_f/collection1/
[junit4:junit4]   2> 6129 T1924 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6134 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6763 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6801 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6801 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6801 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6855 T1924 oasc.ZkController.register We are http://127.0.0.1:28653/_f/collection1/ and leader is http://127.0.0.1:28653/_f/collection1/
[junit4:junit4]   2> 6855 T1924 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28653/_f
[junit4:junit4]   2> 6855 T1924 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6855 T1924 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6856 T1924 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6858 T1924 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6859 T1882 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6859 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6860 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7063 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7066 T1882 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28687
[junit4:junit4]   2> 7067 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7067 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7068 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733
[junit4:junit4]   2> 7068 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/solr.xml
[junit4:junit4]   2> 7068 T1882 oasc.CoreContainer.<init> New CoreContainer 1029438987
[junit4:junit4]   2> 7069 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/'
[junit4:junit4]   2> 7070 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/'
[junit4:junit4]   2> 7111 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 7111 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7112 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7112 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7113 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7113 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7113 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7114 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7114 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7115 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7133 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7151 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:28621/solr
[junit4:junit4]   2> 7151 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7152 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@39e3c63c
[junit4:junit4]   2> 7153 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7153 T1935 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7154 T1935 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 7154 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28688
[junit4:junit4]   2> 7154 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28688
[junit4:junit4]   2> 7156 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0007 with negotiated timeout 20000 for client /140.211.11.196:28688
[junit4:junit4]   2> 7156 T1935 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0007, negotiated timeout = 20000
[junit4:junit4]   2> 7156 T1936 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39e3c63c name:ZooKeeperConnection Watcher:127.0.0.1:28621 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7156 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7157 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b0007
[junit4:junit4]   2> 7158 T1936 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7158 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28688 which had sessionid 0x13c99ffa66b0007
[junit4:junit4]   2> 7158 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b0007 closed
[junit4:junit4]   2> 7159 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 7168 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@386758db
[junit4:junit4]   2> 7169 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7169 T1937 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7170 T1937 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 7170 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28689
[junit4:junit4]   2> 7170 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28689
[junit4:junit4]   2> 7171 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0008 with negotiated timeout 20000 for client /140.211.11.196:28689
[junit4:junit4]   2> 7171 T1937 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0008, negotiated timeout = 20000
[junit4:junit4]   2> 7171 T1938 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@386758db name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7172 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7173 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7174 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7175 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28687__f
[junit4:junit4]   2> 7176 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b0008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:28687__f Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:28687__f
[junit4:junit4]   2> 7184 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28687__f
[junit4:junit4]   2> 7186 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7186 T1910 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7187 T1904 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7187 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7187 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7188 T1923 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7197 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7209 T1939 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/collection1
[junit4:junit4]   2> 7209 T1939 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7210 T1939 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7210 T1939 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7211 T1939 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/collection1/'
[junit4:junit4]   2> 7212 T1939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/collection1/lib/README' to classloader
[junit4:junit4]   2> 7213 T1939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7264 T1939 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 7335 T1939 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7435 T1939 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7440 T1939 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8187 T1939 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8198 T1939 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8202 T1939 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8215 T1939 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8220 T1939 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8224 T1939 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8225 T1939 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8227 T1939 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359793340733/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/
[junit4:junit4]   2> 8227 T1939 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e097617
[junit4:junit4]   2> 8227 T1939 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8228 T1939 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2 forceNew:false
[junit4:junit4]   2> 8229 T1939 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 8229 T1939 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index/
[junit4:junit4]   2> 8230 T1939 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8231 T1939 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index forceNew:false
[junit4:junit4]   2> 8239 T1939 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@579b5027; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8239 T1939 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8240 T1939 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index
[junit4:junit4]   2> 8241 T1939 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8243 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8243 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8243 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8243 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8244 T1939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8244 T1939 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8245 T1939 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8245 T1939 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8246 T1939 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8246 T1939 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8247 T1939 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8247 T1939 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8248 T1939 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8248 T1939 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8248 T1939 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8249 T1939 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8249 T1939 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8250 T1939 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8250 T1939 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8250 T1939 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8251 T1939 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8251 T1939 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8252 T1939 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8252 T1939 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8253 T1939 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8253 T1939 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8261 T1939 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8265 T1939 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8267 T1939 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8270 T1939 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 8273 T1939 oass.SolrIndexSearcher.<init> Opening Searcher@6d356b59 main
[junit4:junit4]   2> 8276 T1939 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8276 T1939 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8277 T1939 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8351 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8357 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28653__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28653/_f"}
[junit4:junit4]   2> 8400 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8402 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8423 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8423 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8438 T1939 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8587 T1940 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d356b59 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8592 T1939 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8593 T1939 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9930 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9933 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28687__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28687/_f"}
[junit4:junit4]   2> 9934 T1905 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 9934 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9958 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9958 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9958 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9958 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10598 T1939 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 10598 T1939 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28687/_f collection:collection1 shard:shard1
[junit4:junit4]   2> 10611 T1939 oasc.ZkController.register We are http://127.0.0.1:28687/_f/collection1/ and leader is http://127.0.0.1:28653/_f/collection1/
[junit4:junit4]   2> 10612 T1939 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28687/_f
[junit4:junit4]   2> 10612 T1939 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 10612 T1939 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@3fd51fb7 url=http://127.0.0.1:28687/_f/collection1 node=127.0.0.1:28687__f C103_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:28687__f, base_url=http://127.0.0.1:28687/_f}
[junit4:junit4]   2> 10613 T1941 C103 P28687 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 10614 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 10614 T1941 C103 P28687 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 10614 T1939 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10614 T1941 C103 P28687 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10616 T1882 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 10617 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 10617 T1941 C103 P28687 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10618 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11085 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11093 T1882 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28737
[junit4:junit4]   2> 11094 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11094 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11095 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506
[junit4:junit4]   2> 11096 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/solr.xml
[junit4:junit4]   2> 11096 T1882 oasc.CoreContainer.<init> New CoreContainer 1548716978
[junit4:junit4]   2> 11098 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/'
[junit4:junit4]   2> 11098 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/'
[junit4:junit4]   2> 11236 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 11236 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11237 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11238 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11238 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11239 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11239 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11240 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11241 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11241 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11292 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11339 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:28621/solr
[junit4:junit4]   2> 11340 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11341 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f794787
[junit4:junit4]   2> 11342 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11345 T1951 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11346 T1951 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 11347 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28738
[junit4:junit4]   2> 11347 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28738
[junit4:junit4]   2> 11350 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b0009 with negotiated timeout 20000 for client /140.211.11.196:28738
[junit4:junit4]   2> 11350 T1951 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b0009, negotiated timeout = 20000
[junit4:junit4]   2> 11350 T1952 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f794787 name:ZooKeeperConnection Watcher:127.0.0.1:28621 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11351 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11352 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b0009
[junit4:junit4]   2> 11381 T1952 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11381 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28738 which had sessionid 0x13c99ffa66b0009
[junit4:junit4]   2> 11381 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b0009 closed
[junit4:junit4]   2> 11383 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 11400 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6ebb7703
[junit4:junit4]   2> 11403 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11404 T1953 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11404 T1953 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 11405 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28739
[junit4:junit4]   2> 11405 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28739
[junit4:junit4]   2> 11407 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b000a with negotiated timeout 20000 for client /140.211.11.196:28739
[junit4:junit4]   2> 11408 T1953 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b000a, negotiated timeout = 20000
[junit4:junit4]   2> 11408 T1954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ebb7703 name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11408 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11411 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b000a type:create cxid:0x1 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11441 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b000a type:create cxid:0x2 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11443 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28737__f
[junit4:junit4]   2> 11444 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b000a type:delete cxid:0x4 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:28737__f Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:28737__f
[junit4:junit4]   2> 11446 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28737__f
[junit4:junit4]   2> 11471 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11471 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11471 T1910 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11472 T1904 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11472 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11472 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11475 T1923 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11476 T1938 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11476 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11477 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28687__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28687/_f"}
[junit4:junit4]   2> 11477 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 11488 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11489 T1954 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11489 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11489 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11496 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11497 T1955 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/collection1
[junit4:junit4]   2> 11497 T1955 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 11498 T1955 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 11498 T1955 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 11500 T1955 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/collection1/'
[junit4:junit4]   2> 11502 T1955 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/collection1/lib/README' to classloader
[junit4:junit4]   2> 11503 T1955 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 11609 T1955 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 11750 T1955 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 11851 T1955 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 11862 T1955 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 12543 T1955 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 12554 T1955 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 12558 T1955 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 12572 T1955 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 12577 T1955 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 12581 T1955 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 12582 T1955 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 12583 T1955 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359793344506/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/
[junit4:junit4]   2> 12584 T1955 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e097617
[junit4:junit4]   2> 12584 T1955 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 12585 T1955 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3 forceNew:false
[junit4:junit4]   2> 12586 T1955 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 12586 T1955 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index/
[junit4:junit4]   2> 12587 T1955 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 12588 T1955 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index forceNew:false
[junit4:junit4]   2> 12596 T1955 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@52799e79; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12596 T1955 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 12597 T1955 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index
[junit4:junit4]   2> 12597 T1955 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 12599 T1955 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 12600 T1955 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 12600 T1955 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 12600 T1955 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 12601 T1955 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 12601 T1955 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 12601 T1955 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 12602 T1955 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 12602 T1955 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 12603 T1955 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 12603 T1955 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 12604 T1955 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 12604 T1955 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 12604 T1955 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 12605 T1955 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 12605 T1955 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 12606 T1955 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12606 T1955 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12607 T1955 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12607 T1955 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12608 T1955 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12608 T1955 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12609 T1955 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12609 T1955 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12609 T1955 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 12610 T1955 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 12617 T1955 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 12621 T1955 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 12622 T1955 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 12624 T1955 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 12626 T1955 oass.SolrIndexSearcher.<init> Opening Searcher@53e2c0ce main
[junit4:junit4]   2> 12627 T1955 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 12627 T1955 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 12627 T1955 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 12639 T1955 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 12705 T1956 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53e2c0ce main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 12715 T1955 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 12715 T1955 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12996 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12997 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28737__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28737/_f"}
[junit4:junit4]   2> 12997 T1905 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 12998 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 13013 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13013 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13013 T1954 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13013 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13013 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2>  C103_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:28687__f, base_url=http://127.0.0.1:28687/_f}
[junit4:junit4]   2> 13669 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28653/_f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 13669 T1941 C103 P28687 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28687/_f START replicas=[http://127.0.0.1:28653/_f/collection1/] nUpdates=100
[junit4:junit4]   2> 13671 T1941 C103 P28687 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 13676 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 13676 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 13677 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 13677 T1941 C103 P28687 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 13677 T1941 C103 P28687 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28653/_f/collection1/. core=collection1
[junit4:junit4]   2> 13677 T1941 C103 P28687 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13719 T1955 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 13720 T1955 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28737/_f collection:collection1 shard:shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C104 name=collection1 org.apache.solr.core.SolrCore@1964b8c9 url=http://127.0.0.1:28653/_f/collection1 node=127.0.0.1:28653__f C104_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28653__f, base_url=http://127.0.0.1:28653/_f, leader=true}
[junit4:junit4]   2> 13756 T1914 C104 P28653 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2 
[junit4:junit4]   2> 13764 T1955 oasc.ZkController.register We are http://127.0.0.1:28737/_f/collection1/ and leader is http://127.0.0.1:28653/_f/collection1/
[junit4:junit4]   2> 13764 T1955 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28737/_f
[junit4:junit4]   2> 13765 T1955 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 13765 T1955 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C105 name=collection1 org.apache.solr.core.SolrCore@185a5fb5 url=http://127.0.0.1:28737/_f/collection1 node=127.0.0.1:28737__f C105_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:28737__f, base_url=http://127.0.0.1:28737/_f}
[junit4:junit4]   2> 13765 T1958 C105 P28737 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 13766 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 13766 T1958 C105 P28737 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 13766 T1958 C105 P28737 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13774 T1955 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13776 T1882 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 13777 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 13777 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13777 T1958 C105 P28737 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13792 T1915 C104 P28653 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 13824 T1915 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 13864 T1915 C104 P28653 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13869 T1915 C104 P28653 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13908 T1915 C104 P28653 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13908 T1915 C104 P28653 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 13916 T1915 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 13917 T1915 C104 P28653 oass.SolrIndexSearcher.<init> Opening Searcher@232d3cc7 realtime
[junit4:junit4]   2> 13918 T1915 C104 P28653 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13918 T1915 C104 P28653 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 126
[junit4:junit4]   2> 13921 T1941 C103 P28687 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13921 T1941 C103 P28687 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 13923 T1916 C104 P28653 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13923 T1916 C104 P28653 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 13924 T1941 C103 P28687 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 13924 T1941 C103 P28687 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 13925 T1941 C103 P28687 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 13929 T1916 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 13933 T1916 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index
[junit4:junit4]   2> 13934 T1916 C104 P28653 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=5 
[junit4:junit4]   2> 13940 T1941 C103 P28687 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 13947 T1941 C103 P28687 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792 forceNew:false
[junit4:junit4]   2> 13951 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 13955 T1941 C103 P28687 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25c9aac9; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 13965 T1916 C104 P28653 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 13980 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index
[junit4:junit4]   2> 13980 T1941 C103 P28687 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 13982 T1941 C103 P28687 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130202022227792
[junit4:junit4]   2> 13990 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 13991 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 13991 T1941 C103 P28687 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792
[junit4:junit4]   2> 13997 T1941 C103 P28687 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25c9aac9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13998 T1941 C103 P28687 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 14005 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 14005 T1941 C103 P28687 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 14005 T1941 C103 P28687 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 14005 T1941 C103 P28687 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 14008 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792
[junit4:junit4]   2> 14012 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 14037 T1941 C103 P28687 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25c9aac9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 14037 T1941 C103 P28687 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 14038 T1941 C103 P28687 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 14039 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 14039 T1941 C103 P28687 oass.SolrIndexSearcher.<init> Opening Searcher@4c97afa5 main
[junit4:junit4]   2> 14042 T1940 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c97afa5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 14043 T1940 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index
[junit4:junit4]   2> 14043 T1941 C103 P28687 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 14076 T1941 C103 P28687 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25c9aac9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25c9aac9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 14077 T1941 C103 P28687 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 14078 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2
[junit4:junit4]   2> 14079 T1941 C103 P28687 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14079 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index.20130202022227792
[junit4:junit4]   2> 14079 T1941 C103 P28687 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty2/index
[junit4:junit4]   2> 14079 T1941 C103 P28687 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 14080 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 14080 T1941 C103 P28687 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 14080 T1941 C103 P28687 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14083 T1941 C103 P28687 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 14257 T1882 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 14260 T1882 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28765
[junit4:junit4]   2> 14262 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 14262 T1882 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 14263 T1882 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669
[junit4:junit4]   2> 14263 T1882 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/solr.xml
[junit4:junit4]   2> 14264 T1882 oasc.CoreContainer.<init> New CoreContainer 1370240142
[junit4:junit4]   2> 14265 T1882 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/'
[junit4:junit4]   2> 14266 T1882 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/'
[junit4:junit4]   2> 14351 T1882 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 14352 T1882 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 14352 T1882 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 14353 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 14354 T1882 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 14354 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 14355 T1882 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 14355 T1882 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 14356 T1882 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 14356 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 14383 T1882 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 14407 T1882 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:28621/solr
[junit4:junit4]   2> 14408 T1882 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 14409 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4077ddc3
[junit4:junit4]   2> 14410 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14411 T1969 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 14412 T1969 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 14412 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28766
[junit4:junit4]   2> 14412 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28766
[junit4:junit4]   2> 14417 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b000b with negotiated timeout 20000 for client /140.211.11.196:28766
[junit4:junit4]   2> 14417 T1969 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b000b, negotiated timeout = 20000
[junit4:junit4]   2> 14417 T1970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4077ddc3 name:ZooKeeperConnection Watcher:127.0.0.1:28621 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14418 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14419 T1887 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c99ffa66b000b
[junit4:junit4]   2> 14425 T1970 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 14425 T1884 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28766 which had sessionid 0x13c99ffa66b000b
[junit4:junit4]   2> 14425 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b000b closed
[junit4:junit4]   2> 14426 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 14440 T1882 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:28621/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@328e20b8
[junit4:junit4]   2> 14441 T1882 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14442 T1971 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:28621. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 14442 T1971 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:28621, initiating session
[junit4:junit4]   2> 14443 T1884 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28767
[junit4:junit4]   2> 14443 T1884 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28767
[junit4:junit4]   2> 14448 T1886 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c99ffa66b000c with negotiated timeout 20000 for client /140.211.11.196:28767
[junit4:junit4]   2> 14448 T1971 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:28621, sessionid = 0x13c99ffa66b000c, negotiated timeout = 20000
[junit4:junit4]   2> 14448 T1972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@328e20b8 name:ZooKeeperConnection Watcher:127.0.0.1:28621/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14448 T1882 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14449 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b000c type:create cxid:0x1 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14458 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b000c type:create cxid:0x2 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14460 T1882 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28765__f
[junit4:junit4]   2> 14460 T1887 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c99ffa66b000c type:delete cxid:0x4 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:28765__f Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:28765__f
[junit4:junit4]   2> 14461 T1882 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28765__f
[junit4:junit4]   2> 14463 T1954 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14463 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14464 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14464 T1904 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14464 T1910 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14464 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14464 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14465 T1954 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14465 T1923 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14465 T1938 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14468 T1882 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 14475 T1973 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/collection1
[junit4:junit4]   2> 14475 T1973 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14476 T1973 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14476 T1973 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14478 T1973 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/collection1/'
[junit4:junit4]   2> 14479 T1973 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14479 T1973 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/collection1/lib/README' to classloader
[junit4:junit4]   2> 14525 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14526 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28737__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28737/_f"}
[junit4:junit4]   2> 14534 T1973 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 14539 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28687__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28687/_f"}
[junit4:junit4]   2> 14566 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14565 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14566 T1954 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14566 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14566 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14566 T1972 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14603 T1973 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14704 T1973 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14708 T1973 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15170 T1973 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15178 T1973 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15181 T1973 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15191 T1973 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15194 T1973 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15197 T1973 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15198 T1973 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15199 T1973 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359793347669/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/
[junit4:junit4]   2> 15199 T1973 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e097617
[junit4:junit4]   2> 15200 T1973 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 15200 T1973 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4 forceNew:false
[junit4:junit4]   2> 15201 T1973 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 15201 T1973 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index/
[junit4:junit4]   2> 15201 T1973 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15202 T1973 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index forceNew:false
[junit4:junit4]   2> 15206 T1973 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fedf49; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15207 T1973 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15208 T1973 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index
[junit4:junit4]   2> 15208 T1973 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 15210 T1973 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15210 T1973 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 15210 T1973 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15211 T1973 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 15211 T1973 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15212 T1973 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15212 T1973 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15212 T1973 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15213 T1973 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15214 T1973 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 15214 T1973 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 15214 T1973 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15215 T1973 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 15215 T1973 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 15215 T1973 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 15216 T1973 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15216 T1973 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15217 T1973 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15217 T1973 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15218 T1973 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15218 T1973 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15219 T1973 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15219 T1973 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15220 T1973 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15220 T1973 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 15221 T1973 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 15229 T1973 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15234 T1973 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 15236 T1973 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 15238 T1973 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 15240 T1973 oass.SolrIndexSearcher.<init> Opening Searcher@68ab638b main
[junit4:junit4]   2> 15241 T1973 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15241 T1973 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15242 T1973 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 15258 T1973 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 15315 T1974 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@68ab638b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15320 T1973 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15320 T1973 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16088 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16089 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28765__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28765/_f"}
[junit4:junit4]   2> 16089 T1905 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 16090 T1905 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 16102 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16102 T1972 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16102 T1954 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16102 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16102 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16102 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16322 T1973 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16322 T1973 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28765/_f collection:collection1 shard:shard1
[junit4:junit4]   2> 16325 T1973 oasc.ZkController.register We are http://127.0.0.1:28765/_f/collection1/ and leader is http://127.0.0.1:28653/_f/collection1/
[junit4:junit4]   2> 16325 T1973 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28765/_f
[junit4:junit4]   2> 16326 T1973 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16326 T1973 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C106 name=collection1 org.apache.solr.core.SolrCore@42cd554 url=http://127.0.0.1:28765/_f/collection1 node=127.0.0.1:28765__f C106_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:28765__f, base_url=http://127.0.0.1:28765/_f}
[junit4:junit4]   2> 16326 T1975 C106 P28765 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16327 T1973 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16327 T1975 C106 P28765 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16328 T1975 C106 P28765 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16328 T1975 C106 P28765 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16328 T1882 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 16329 T1882 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16329 T1975 C106 P28765 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16329 T1882 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16345 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16346 T1882 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 16346 T1882 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 16347 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C105_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:28737__f, base_url=http://127.0.0.1:28737/_f}
[junit4:junit4]   2> 17004 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28653/_f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 17004 T1958 C105 P28737 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28737/_f START replicas=[http://127.0.0.1:28653/_f/collection1/] nUpdates=100
[junit4:junit4]   2> 17004 T1958 C105 P28737 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 17005 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 17005 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 17006 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 17006 T1958 C105 P28737 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 17006 T1958 C105 P28737 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28653/_f/collection1/. core=collection1
[junit4:junit4]   2> 17006 T1958 C105 P28737 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17007 T1914 C104 P28653 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 17016 T1919 C104 P28653 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 17020 T1919 C104 P28653 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 17021 T1919 C104 P28653 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 17022 T1919 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 17022 T1919 C104 P28653 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 17022 T1919 C104 P28653 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 17023 T1958 C105 P28737 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17023 T1958 C105 P28737 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 17025 T1916 C104 P28653 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 17026 T1958 C105 P28737 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 17026 T1958 C105 P28737 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 17026 T1958 C105 P28737 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 17028 T1916 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 17029 T1916 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index
[junit4:junit4]   2> 17029 T1916 C104 P28653 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1 
[junit4:junit4]   2> 17030 T1958 C105 P28737 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 17031 T1958 C105 P28737 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881 forceNew:false
[junit4:junit4]   2> 17032 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17032 T1958 C105 P28737 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11e940d6; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 17036 T1916 C104 P28653 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   2> 17038 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index
[junit4:junit4]   2> 17038 T1958 C105 P28737 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 17039 T1958 C105 P28737 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130202022230881
[junit4:junit4]   2> 17040 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17040 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17040 T1958 C105 P28737 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881
[junit4:junit4]   2> 17044 T1958 C105 P28737 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11e940d6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 17044 T1958 C105 P28737 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 17046 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17046 T1958 C105 P28737 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 17046 T1958 C105 P28737 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 17046 T1958 C105 P28737 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 17047 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881
[junit4:junit4]   2> 17047 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17050 T1958 C105 P28737 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11e940d6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 17051 T1958 C105 P28737 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 17051 T1958 C105 P28737 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 17051 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17052 T1958 C105 P28737 oass.SolrIndexSearcher.<init> Opening Searcher@204cc616 main
[junit4:junit4]   2> 17053 T1956 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@204cc616 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 17053 T1956 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index
[junit4:junit4]   2> 17054 T1958 C105 P28737 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 17057 T1958 C105 P28737 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11e940d6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11e940d6; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 17057 T1958 C105 P28737 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 17058 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3
[junit4:junit4]   2> 17058 T1958 C105 P28737 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 17059 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index.20130202022230881
[junit4:junit4]   2> 17059 T1958 C105 P28737 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty3/index
[junit4:junit4]   2> 17059 T1958 C105 P28737 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 17059 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 17059 T1958 C105 P28737 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 17059 T1958 C105 P28737 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17067 T1958 C105 P28737 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 17349 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17606 T1905 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17607 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28765__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28765/_f"}
[junit4:junit4]   2> 17612 T1905 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:28737__f",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:28737/_f"}
[junit4:junit4]   2> 17635 T1904 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17635 T1972 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17635 T1938 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17635 T1923 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17635 T1954 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17635 T1910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18351 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19353 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C106_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:28765__f, base_url=http://127.0.0.1:28765/_f}
[junit4:junit4]   2> 20348 T1975 C106 P28765 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28653/_f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 20348 T1975 C106 P28765 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28765/_f START replicas=[http://127.0.0.1:28653/_f/collection1/] nUpdates=100
[junit4:junit4]   2> 20349 T1975 C106 P28765 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 20349 T1975 C106 P28765 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 20349 T1975 C106 P28765 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 20349 T1975 C106 P28765 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 20349 T1975 C106 P28765 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 20350 T1975 C106 P28765 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28653/_f/collection1/. core=collection1
[junit4:junit4]   2> 20350 T1975 C106 P28765 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20351 T1914 C104 P28653 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 20355 T1882 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20364 T1913 C104 P28653 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 20368 T1913 C104 P28653 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f7884c3; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 20369 T1913 C104 P28653 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 20370 T1913 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 20370 T1913 C104 P28653 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 20371 T1913 C104 P28653 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 20371 T1975 C106 P28765 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 20372 T1975 C106 P28765 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 20374 T1916 C104 P28653 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 20375 T1975 C106 P28765 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 20375 T1975 C106 P28765 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 20375 T1975 C106 P28765 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 20377 T1916 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1
[junit4:junit4]   2> 20378 T1916 C104 P28653 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty1/index
[junit4:junit4]   2> 20378 T1916 C104 P28653 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1 
[junit4:junit4]   2> 20379 T1975 C106 P28765 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 20380 T1975 C106 P28765 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index.20130202022234230 forceNew:false
[junit4:junit4]   2> 20381 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 20382 T1975 C106 P28765 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index.20130202022234230 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3cbef088; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 20385 T1916 C104 P28653 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 20386 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index
[junit4:junit4]   2> 20387 T1975 C106 P28765 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 20387 T1975 C106 P28765 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130202022234230
[junit4:junit4]   2> 20388 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 20389 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 20389 T1975 C106 P28765 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index.20130202022234230
[junit4:junit4]   2> 20392 T1975 C106 P28765 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index.20130202022234230 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3cbef088; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 20393 T1975 C106 P28765 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 20394 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 20394 T1975 C106 P28765 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 20394 T1975 C106 P28765 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 20394 T1975 C106 P28765 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 20395 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index.20130202022234230
[junit4:junit4]   2> 20396 T1975 C106 P28765 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 20399 T1975 C106 P28765 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4/index.2013

[...truncated too long message...]

a6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1359793333856/jetty4
[junit4:junit4]   2> 167411 T1972 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 167411 T1882 oaz.ZooKeeper.close Session: 0x13c99ffa66b000c closed
[junit4:junit4]   2> 167412 T1882 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_f,null}
[junit4:junit4]   2> 167723 T1882 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=474A1B68E474A41A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=be -Dtests.timezone=SystemV/CST6 -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE  168s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([474A1B68E474A41A:C6AC9570932BC426]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 167741 T1882 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=NestedPulsing), text=Pulsing41(freqCutoff=20 minBlockSize=94 maxBlockSize=253), _version_=Pulsing41(freqCutoff=2 minBlockSize=94 maxBlockSize=253), rnd_b=Lucene41(blocksize=128), intDefault=Pulsing41(freqCutoff=2 minBlockSize=94 maxBlockSize=253), id=Lucene41(blocksize=128), timestamp=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=NestedPulsing), range_facet_sl=Lucene41(blocksize=128), range_facet_si=PostingsFormat(name=NestedPulsing), other_tl1=Pulsing41(freqCutoff=2 minBlockSize=94 maxBlockSize=253), multiDefault=PostingsFormat(name=NestedPulsing), a_si=Pulsing41(freqCutoff=2 minBlockSize=94 maxBlockSize=253)}, sim=DefaultSimilarity, locale=be, timezone=SystemV/CST6
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=192805760,total=357629952
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SpellCheckCollatorTest, PreAnalyzedFieldTest, TestBinaryResponseWriter, TestIBSimilarityFactory, CoreAdminHandlerTest, SuggesterFSTTest, MoreLikeThisHandlerTest, DirectSolrConnectionTest, DistanceFunctionTest, FieldAnalysisRequestHandlerTest, JSONWriterTest, TestFaceting, SpellPossibilityIteratorTest, AutoCommitTest, SimplePostToolTest, SolrCmdDistributorTest, ChaosMonkeySafeLeaderTest, QueryElevationComponentTest, BasicDistributedZkTest, TestElisionMultitermQuery, TestComponentsName, CSVRequestHandlerTest, HighlighterConfigTest, TestSolrIndexConfig, CoreContainerCoreInitFailuresTest, UniqFieldsUpdateProcessorFactoryTest, TestFuzzyAnalyzedSuggestions, TestRandomFaceting, TestLMJelinekMercerSimilarityFactory, DateFieldTest, FastVectorHighlighterTest, CurrencyFieldTest, TestExtendedDismaxParser, TestConfig, WordBreakSolrSpellCheckerTest, TestSystemIdResolver, TestJmxMonitoredMap, ScriptEngineTest, TestJoin, DistributedTermsComponentTest, LeaderElectionIntegrationTest, TestPHPSerializedResponseWriter, TestGroupingSearch, ChaosMonkeyNothingIsSafeTest, TestDocumentBuilder, UpdateRequestProcessorFactoryTest, TestZkChroot, TestLazyCores, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, SOLR749Test, BinaryUpdateRequestHandlerTest, MBeansHandlerTest, ExternalFileFieldSortTest, AlternateDirectoryTest, TestLMDirichletSimilarityFactory, SolrCoreCheckLockOnStartupTest, SpatialFilterTest, ShardRoutingTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 167.77s, 1 test, 1 failure <<< FAILURES!

[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:841: There were test failures: 250 suites, 1041 tests, 1 failure, 23 ignored (5 assumptions)

Total time: 34 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1303 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1303/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 should have just been set up to be inconsistent - but it's still consistent

Stack Trace:
java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
	at __randomizedtesting.SeedInfo.seed([6AA35BCDC70B7AFA:EB45D5D5B0541AC6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8188 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T1179 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /i_d/ql
[junit4:junit4]   2> 3 T1179 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1359834888038
[junit4:junit4]   2> 4 T1179 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 5 T1180 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 7 T1180 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T1180 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 7 T1180 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 7 T1180 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8 T1180 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 106 T1179 oasc.ZkTestServer.run start zk server on port:37189
[junit4:junit4]   2> 106 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1740f923
[junit4:junit4]   2> 107 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 107 T1185 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 108 T1185 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 108 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37190
[junit4:junit4]   2> 108 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37190
[junit4:junit4]   2> 109 T1183 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 136 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0000 with negotiated timeout 10000 for client /140.211.11.196:37190
[junit4:junit4]   2> 136 T1185 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0000, negotiated timeout = 10000
[junit4:junit4]   2> 136 T1186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1740f923 name:ZooKeeperConnection Watcher:127.0.0.1:37189 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 137 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 137 T1179 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 140 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a0000
[junit4:junit4]   2> 147 T1186 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 147 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a0000 closed
[junit4:junit4]   2> 147 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37190 which had sessionid 0x13c9c79b76a0000
[junit4:junit4]   2> 147 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b492b79
[junit4:junit4]   2> 148 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 148 T1187 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 149 T1187 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 149 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37191
[junit4:junit4]   2> 149 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37191
[junit4:junit4]   2> 150 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0001 with negotiated timeout 10000 for client /140.211.11.196:37191
[junit4:junit4]   2> 151 T1187 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0001, negotiated timeout = 10000
[junit4:junit4]   2> 151 T1188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b492b79 name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 151 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 151 T1179 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 161 T1179 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 165 T1179 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 169 T1179 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 173 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 173 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 185 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 185 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 289 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 290 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 293 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 293 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 304 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 305 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 309 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 309 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 313 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 313 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 317 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 318 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 322 T1179 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 322 T1179 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 327 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a0001
[junit4:junit4]   2> 328 T1188 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 328 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37191 which had sessionid 0x13c9c79b76a0001
[junit4:junit4]   2> 328 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a0001 closed
[junit4:junit4]   2> 437 T1179 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 441 T1179 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37192
[junit4:junit4]   2> 441 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 442 T1179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 442 T1179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366
[junit4:junit4]   2> 442 T1179 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/solr.xml
[junit4:junit4]   2> 443 T1179 oasc.CoreContainer.<init> New CoreContainer 455096628
[junit4:junit4]   2> 443 T1179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/'
[junit4:junit4]   2> 444 T1179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/'
[junit4:junit4]   2> 472 T1179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 472 T1179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 472 T1179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 473 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 473 T1179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 473 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 473 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 474 T1179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 474 T1179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 474 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 488 T1179 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 501 T1179 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37189/solr
[junit4:junit4]   2> 501 T1179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 502 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6b550f77
[junit4:junit4]   2> 502 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 503 T1198 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 504 T1198 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 504 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37193
[junit4:junit4]   2> 504 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37193
[junit4:junit4]   2> 506 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0002 with negotiated timeout 20000 for client /140.211.11.196:37193
[junit4:junit4]   2> 506 T1198 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0002, negotiated timeout = 20000
[junit4:junit4]   2> 506 T1199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b550f77 name:ZooKeeperConnection Watcher:127.0.0.1:37189 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 506 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 508 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a0002
[junit4:junit4]   2> 509 T1199 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 509 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37193 which had sessionid 0x13c9c79b76a0002
[junit4:junit4]   2> 509 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a0002 closed
[junit4:junit4]   2> 509 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 517 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@49f65429
[junit4:junit4]   2> 518 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 518 T1200 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 518 T1200 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 519 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37194
[junit4:junit4]   2> 519 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37194
[junit4:junit4]   2> 520 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0003 with negotiated timeout 20000 for client /140.211.11.196:37194
[junit4:junit4]   2> 520 T1200 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0003, negotiated timeout = 20000
[junit4:junit4]   2> 520 T1201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49f65429 name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 521 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 523 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 531 T1179 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 533 T1179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37192_i_d%2Fql
[junit4:junit4]   2> 534 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37192_i_d%2Fql Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37192_i_d%2Fql
[junit4:junit4]   2> 535 T1179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37192_i_d%2Fql
[junit4:junit4]   2> 545 T1179 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 557 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 558 T1179 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 565 T1179 oasc.Overseer.start Overseer (id=89118139222720515-127.0.0.1:37192_i_d%2Fql-n_0000000000) starting
[junit4:junit4]   2> 565 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 566 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 568 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 577 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 579 T1203 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 580 T1179 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 584 T1179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 586 T1202 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 591 T1204 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/collection1
[junit4:junit4]   2> 592 T1204 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 592 T1204 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 593 T1204 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 594 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/collection1/'
[junit4:junit4]   2> 595 T1204 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 596 T1204 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/collection1/lib/README' to classloader
[junit4:junit4]   2> 648 T1204 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 719 T1204 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 820 T1204 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 826 T1204 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1450 T1204 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1461 T1204 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1465 T1204 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1485 T1204 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1490 T1204 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1495 T1204 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1497 T1204 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1498 T1204 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359834888366/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data/
[junit4:junit4]   2> 1499 T1204 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b478a2d
[junit4:junit4]   2> 1499 T1204 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1500 T1204 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data forceNew:false
[junit4:junit4]   2> 1501 T1204 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data
[junit4:junit4]   2> 1502 T1204 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data/index/
[junit4:junit4]   2> 1503 T1204 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1504 T1204 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data/index forceNew:false
[junit4:junit4]   2> 1528 T1204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@77624599; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1529 T1204 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1530 T1204 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data/index
[junit4:junit4]   2> 1530 T1204 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1532 T1204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1532 T1204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1533 T1204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1533 T1204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1534 T1204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1534 T1204 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1534 T1204 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1535 T1204 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1535 T1204 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1536 T1204 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1537 T1204 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1537 T1204 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1537 T1204 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1538 T1204 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1538 T1204 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1539 T1204 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1539 T1204 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1540 T1204 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1540 T1204 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1541 T1204 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1541 T1204 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1542 T1204 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1542 T1204 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1543 T1204 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1543 T1204 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1544 T1204 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1551 T1204 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1556 T1204 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1558 T1204 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1560 T1204 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/control/data
[junit4:junit4]   2> 1562 T1204 oass.SolrIndexSearcher.<init> Opening Searcher@269b96ed main
[junit4:junit4]   2> 1563 T1204 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1564 T1204 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1564 T1204 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1571 T1204 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1631 T1205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@269b96ed main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1637 T1204 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1637 T1204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1638 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2092 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2093 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37192_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37192/i_d/ql"}
[junit4:junit4]   2> 2093 T1202 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2093 T1202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2093 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2125 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2652 T1204 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2652 T1204 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37192/i_d/ql collection:control_collection shard:shard1
[junit4:junit4]   2> 2653 T1204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2670 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2671 T1204 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2672 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2681 T1204 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2681 T1204 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2681 T1204 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37192/i_d/ql/collection1/
[junit4:junit4]   2> 2681 T1204 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2681 T1204 oasc.SyncStrategy.syncToMe http://127.0.0.1:37192/i_d/ql/collection1/ has no replicas
[junit4:junit4]   2> 2682 T1204 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37192/i_d/ql/collection1/
[junit4:junit4]   2> 2682 T1204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2687 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3636 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3655 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3666 T1204 oasc.ZkController.register We are http://127.0.0.1:37192/i_d/ql/collection1/ and leader is http://127.0.0.1:37192/i_d/ql/collection1/
[junit4:junit4]   2> 3666 T1204 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37192/i_d/ql
[junit4:junit4]   2> 3666 T1204 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3666 T1204 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3666 T1204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3669 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3670 T1179 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3671 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3672 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3686 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3696 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3884b421
[junit4:junit4]   2> 3697 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3697 T1206 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3698 T1206 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 3698 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37197
[junit4:junit4]   2> 3699 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37197
[junit4:junit4]   2> 3700 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0004 with negotiated timeout 10000 for client /140.211.11.196:37197
[junit4:junit4]   2> 3700 T1206 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0004, negotiated timeout = 10000
[junit4:junit4]   2> 3701 T1207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3884b421 name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3701 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3703 T1179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3705 T1179 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3869 T1179 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3871 T1179 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37198
[junit4:junit4]   2> 3872 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3873 T1179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3873 T1179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739
[junit4:junit4]   2> 3873 T1179 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/solr.xml
[junit4:junit4]   2> 3874 T1179 oasc.CoreContainer.<init> New CoreContainer 1423504207
[junit4:junit4]   2> 3875 T1179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/'
[junit4:junit4]   2> 3875 T1179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/'
[junit4:junit4]   2> 3919 T1179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 3920 T1179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3920 T1179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3920 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3921 T1179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3921 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3922 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3922 T1179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3923 T1179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3923 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3943 T1179 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3962 T1179 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37189/solr
[junit4:junit4]   2> 3963 T1179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3963 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@66901391
[junit4:junit4]   2> 3964 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3965 T1217 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3965 T1217 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 3966 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37199
[junit4:junit4]   2> 3966 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37199
[junit4:junit4]   2> 3967 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0005 with negotiated timeout 20000 for client /140.211.11.196:37199
[junit4:junit4]   2> 3968 T1217 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0005, negotiated timeout = 20000
[junit4:junit4]   2> 3968 T1218 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66901391 name:ZooKeeperConnection Watcher:127.0.0.1:37189 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3968 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3970 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a0005
[junit4:junit4]   2> 3971 T1218 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3971 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37199 which had sessionid 0x13c9c79b76a0005
[junit4:junit4]   2> 3971 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a0005 closed
[junit4:junit4]   2> 3972 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 3983 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5775b96e
[junit4:junit4]   2> 3984 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3984 T1219 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3985 T1219 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 3985 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37200
[junit4:junit4]   2> 3985 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37200
[junit4:junit4]   2> 3987 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0006 with negotiated timeout 20000 for client /140.211.11.196:37200
[junit4:junit4]   2> 3987 T1219 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0006, negotiated timeout = 20000
[junit4:junit4]   2> 3987 T1220 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5775b96e name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3987 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3989 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3990 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3998 T1179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37198_i_d%2Fql
[junit4:junit4]   2> 3999 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37198_i_d%2Fql Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37198_i_d%2Fql
[junit4:junit4]   2> 4000 T1179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37198_i_d%2Fql
[junit4:junit4]   2> 4005 T1207 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4005 T1201 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4005 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4009 T1179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4017 T1221 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/collection1
[junit4:junit4]   2> 4017 T1221 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4018 T1221 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4018 T1221 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4020 T1221 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/collection1/'
[junit4:junit4]   2> 4021 T1221 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/collection1/lib/README' to classloader
[junit4:junit4]   2> 4022 T1221 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4075 T1221 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 4146 T1221 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4247 T1221 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4253 T1221 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4879 T1221 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4890 T1221 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4895 T1221 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4913 T1221 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4918 T1221 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4923 T1221 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4925 T1221 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4926 T1221 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359834891739/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/
[junit4:junit4]   2> 4927 T1221 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b478a2d
[junit4:junit4]   2> 4927 T1221 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 4928 T1221 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1 forceNew:false
[junit4:junit4]   2> 4929 T1221 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 4929 T1221 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index/
[junit4:junit4]   2> 4930 T1221 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4931 T1221 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index forceNew:false
[junit4:junit4]   2> 4969 T1221 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4969 T1221 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4970 T1221 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index
[junit4:junit4]   2> 4970 T1221 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4972 T1221 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4973 T1221 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4973 T1221 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4973 T1221 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4974 T1221 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4974 T1221 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4975 T1221 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4975 T1221 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4976 T1221 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4976 T1221 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4977 T1221 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4977 T1221 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4978 T1221 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4978 T1221 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4979 T1221 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4979 T1221 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4980 T1221 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4980 T1221 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4981 T1221 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4981 T1221 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4982 T1221 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4982 T1221 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4983 T1221 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4983 T1221 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4984 T1221 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4984 T1221 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4992 T1221 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4996 T1221 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4998 T1221 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5000 T1221 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 5002 T1221 oass.SolrIndexSearcher.<init> Opening Searcher@c628e4 main
[junit4:junit4]   2> 5003 T1221 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5003 T1221 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5004 T1221 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5011 T1221 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5062 T1222 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c628e4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5067 T1221 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5067 T1221 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5163 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5164 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37192_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37192/i_d/ql"}
[junit4:junit4]   2> 5169 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37198_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37198/i_d/ql"}
[junit4:junit4]   2> 5170 T1202 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 5170 T1202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5181 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5181 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5181 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6070 T1221 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6070 T1221 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37198/i_d/ql collection:collection1 shard:shard1
[junit4:junit4]   2> 6071 T1221 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6117 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6117 T1221 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6118 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6129 T1221 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6129 T1221 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6129 T1221 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37198/i_d/ql/collection1/
[junit4:junit4]   2> 6129 T1221 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6130 T1221 oasc.SyncStrategy.syncToMe http://127.0.0.1:37198/i_d/ql/collection1/ has no replicas
[junit4:junit4]   2> 6130 T1221 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37198/i_d/ql/collection1/
[junit4:junit4]   2> 6130 T1221 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6136 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6697 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6768 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6768 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6768 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6809 T1221 oasc.ZkController.register We are http://127.0.0.1:37198/i_d/ql/collection1/ and leader is http://127.0.0.1:37198/i_d/ql/collection1/
[junit4:junit4]   2> 6809 T1221 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37198/i_d/ql
[junit4:junit4]   2> 6809 T1221 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6809 T1221 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6810 T1221 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6812 T1221 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6813 T1179 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 6814 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6815 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6989 T1179 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6993 T1179 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37202
[junit4:junit4]   2> 6994 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6994 T1179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6994 T1179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862
[junit4:junit4]   2> 6995 T1179 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/solr.xml
[junit4:junit4]   2> 6995 T1179 oasc.CoreContainer.<init> New CoreContainer 414298075
[junit4:junit4]   2> 6996 T1179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/'
[junit4:junit4]   2> 6997 T1179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/'
[junit4:junit4]   2> 7039 T1179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 7039 T1179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7040 T1179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7040 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7041 T1179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7041 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7042 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7042 T1179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7043 T1179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7043 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7062 T1179 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7080 T1179 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37189/solr
[junit4:junit4]   2> 7081 T1179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7081 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@356fb597
[junit4:junit4]   2> 7082 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7083 T1232 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7084 T1232 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 7084 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37203
[junit4:junit4]   2> 7084 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37203
[junit4:junit4]   2> 7091 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0007 with negotiated timeout 20000 for client /140.211.11.196:37203
[junit4:junit4]   2> 7091 T1232 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0007, negotiated timeout = 20000
[junit4:junit4]   2> 7091 T1233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@356fb597 name:ZooKeeperConnection Watcher:127.0.0.1:37189 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7091 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7093 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a0007
[junit4:junit4]   2> 7094 T1233 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7094 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37203 which had sessionid 0x13c9c79b76a0007
[junit4:junit4]   2> 7094 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a0007 closed
[junit4:junit4]   2> 7095 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 7104 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d37f2ea
[junit4:junit4]   2> 7105 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7105 T1234 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7106 T1234 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 7106 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37204
[junit4:junit4]   2> 7107 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37204
[junit4:junit4]   2> 7108 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0008 with negotiated timeout 20000 for client /140.211.11.196:37204
[junit4:junit4]   2> 7108 T1234 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0008, negotiated timeout = 20000
[junit4:junit4]   2> 7108 T1235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d37f2ea name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7109 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7110 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7111 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7119 T1179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37202_i_d%2Fql
[junit4:junit4]   2> 7120 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a0008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37202_i_d%2Fql Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37202_i_d%2Fql
[junit4:junit4]   2> 7121 T1179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37202_i_d%2Fql
[junit4:junit4]   2> 7124 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7125 T1220 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7125 T1201 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7125 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7125 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7127 T1207 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7130 T1179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7137 T1236 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/collection1
[junit4:junit4]   2> 7137 T1236 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7138 T1236 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7138 T1236 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7140 T1236 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/collection1/'
[junit4:junit4]   2> 7141 T1236 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/collection1/lib/README' to classloader
[junit4:junit4]   2> 7141 T1236 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7194 T1236 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 7275 T1236 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7376 T1236 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7382 T1236 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8005 T1236 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8016 T1236 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8020 T1236 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8043 T1236 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8048 T1236 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8053 T1236 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8055 T1236 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8057 T1236 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359834894862/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/
[junit4:junit4]   2> 8057 T1236 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b478a2d
[junit4:junit4]   2> 8058 T1236 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8059 T1236 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2 forceNew:false
[junit4:junit4]   2> 8059 T1236 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 8059 T1236 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index/
[junit4:junit4]   2> 8060 T1236 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8061 T1236 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index forceNew:false
[junit4:junit4]   2> 8068 T1236 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27a9195c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8068 T1236 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8069 T1236 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index
[junit4:junit4]   2> 8070 T1236 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8072 T1236 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8072 T1236 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8072 T1236 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8073 T1236 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8073 T1236 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8074 T1236 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8074 T1236 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8075 T1236 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8075 T1236 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8076 T1236 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8076 T1236 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8077 T1236 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8077 T1236 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8077 T1236 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8078 T1236 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8078 T1236 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8079 T1236 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8079 T1236 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8080 T1236 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8081 T1236 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8081 T1236 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8082 T1236 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8082 T1236 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8083 T1236 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8083 T1236 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8084 T1236 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8091 T1236 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8096 T1236 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8097 T1236 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8100 T1236 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 8102 T1236 oass.SolrIndexSearcher.<init> Opening Searcher@6e07e6fc main
[junit4:junit4]   2> 8103 T1236 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8103 T1236 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8103 T1236 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8111 T1236 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8167 T1237 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e07e6fc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8173 T1236 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8173 T1236 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8305 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8306 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37198_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37198/i_d/ql"}
[junit4:junit4]   2> 8320 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37202_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37202/i_d/ql"}
[junit4:junit4]   2> 8320 T1202 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 8321 T1202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8333 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8333 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8334 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8334 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9176 T1236 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9176 T1236 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37202/i_d/ql collection:collection1 shard:shard1
[junit4:junit4]   2> 9182 T1236 oasc.ZkController.register We are http://127.0.0.1:37202/i_d/ql/collection1/ and leader is http://127.0.0.1:37198/i_d/ql/collection1/
[junit4:junit4]   2> 9182 T1236 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37202/i_d/ql
[junit4:junit4]   2> 9182 T1236 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 9182 T1236 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C105 name=collection1 org.apache.solr.core.SolrCore@793a532a url=http://127.0.0.1:37202/i_d/ql/collection1 node=127.0.0.1:37202_i_d%2Fql C105_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:37202_i_d%2Fql, base_url=http://127.0.0.1:37202/i_d/ql}
[junit4:junit4]   2> 9183 T1238 C105 P37202 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 9183 T1236 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9184 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9184 T1238 C105 P37202 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 9184 T1238 C105 P37202 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9185 T1179 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 9186 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9186 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9187 T1238 C105 P37202 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9378 T1179 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9381 T1179 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37212
[junit4:junit4]   2> 9382 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9383 T1179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9383 T1179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243
[junit4:junit4]   2> 9383 T1179 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/solr.xml
[junit4:junit4]   2> 9384 T1179 oasc.CoreContainer.<init> New CoreContainer 674562309
[junit4:junit4]   2> 9385 T1179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/'
[junit4:junit4]   2> 9385 T1179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/'
[junit4:junit4]   2> 9432 T1179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 9432 T1179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9433 T1179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9433 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9434 T1179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9434 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9434 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9435 T1179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9435 T1179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9436 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9459 T1179 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9479 T1179 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37189/solr
[junit4:junit4]   2> 9480 T1179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9480 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b9902f7
[junit4:junit4]   2> 9481 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9482 T1248 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9483 T1248 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 9483 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37214
[junit4:junit4]   2> 9484 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37214
[junit4:junit4]   2> 9485 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a0009 with negotiated timeout 20000 for client /140.211.11.196:37214
[junit4:junit4]   2> 9486 T1248 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a0009, negotiated timeout = 20000
[junit4:junit4]   2> 9486 T1249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b9902f7 name:ZooKeeperConnection Watcher:127.0.0.1:37189 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9486 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9488 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a0009
[junit4:junit4]   2> 9495 T1249 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9496 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37214 which had sessionid 0x13c9c79b76a0009
[junit4:junit4]   2> 9495 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a0009 closed
[junit4:junit4]   2> 9496 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 9507 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2202931f
[junit4:junit4]   2> 9508 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9508 T1250 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9509 T1250 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 9509 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37215
[junit4:junit4]   2> 9510 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37215
[junit4:junit4]   2> 9511 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a000a with negotiated timeout 20000 for client /140.211.11.196:37215
[junit4:junit4]   2> 9511 T1250 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a000a, negotiated timeout = 20000
[junit4:junit4]   2> 9512 T1251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2202931f name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9512 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9513 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a000a type:create cxid:0x1 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9515 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a000a type:create cxid:0x2 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9522 T1179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37212_i_d%2Fql
[junit4:junit4]   2> 9523 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a000a type:delete cxid:0x4 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37212_i_d%2Fql Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37212_i_d%2Fql
[junit4:junit4]   2> 9524 T1179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37212_i_d%2Fql
[junit4:junit4]   2> 9527 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9528 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9528 T1201 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9528 T1220 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9528 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9529 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9530 T1235 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9532 T1207 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9533 T1179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9541 T1252 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/collection1
[junit4:junit4]   2> 9541 T1252 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9542 T1252 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9542 T1252 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9544 T1252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/collection1/'
[junit4:junit4]   2> 9545 T1252 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/collection1/lib/README' to classloader
[junit4:junit4]   2> 9546 T1252 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9602 T1252 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 9682 T1252 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9783 T1252 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9789 T1252 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9843 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9844 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37202_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37202/i_d/ql"}
[junit4:junit4]   2> 9859 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9859 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9859 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9859 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9859 T1251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10441 T1252 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10452 T1252 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10457 T1252 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10478 T1252 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10484 T1252 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10489 T1252 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10491 T1252 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10493 T1252 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359834897243/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/
[junit4:junit4]   2> 10493 T1252 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b478a2d
[junit4:junit4]   2> 10494 T1252 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10495 T1252 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3 forceNew:false
[junit4:junit4]   2> 10495 T1252 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 10496 T1252 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index/
[junit4:junit4]   2> 10496 T1252 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10498 T1252 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index forceNew:false
[junit4:junit4]   2> 10503 T1252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1557bfc5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10504 T1252 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10505 T1252 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index
[junit4:junit4]   2> 10505 T1252 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10507 T1252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10507 T1252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10508 T1252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10508 T1252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10509 T1252 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10509 T1252 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10509 T1252 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10510 T1252 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10510 T1252 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10511 T1252 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10512 T1252 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10512 T1252 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10513 T1252 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10513 T1252 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10513 T1252 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10514 T1252 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10514 T1252 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10515 T1252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10515 T1252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10516 T1252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10516 T1252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10517 T1252 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10517 T1252 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10518 T1252 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10518 T1252 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10519 T1252 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10526 T1252 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10531 T1252 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10532 T1252 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 10534 T1252 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 10536 T1252 oass.SolrIndexSearcher.<init> Opening Searcher@5578a413 main
[junit4:junit4]   2> 10537 T1252 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10537 T1252 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10538 T1252 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10545 T1252 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 10595 T1253 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5578a413 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10600 T1252 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10600 T1252 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11366 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11367 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37212_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37212/i_d/ql"}
[junit4:junit4]   2> 11367 T1202 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11368 T1202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11381 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11382 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11382 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11382 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11382 T1251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11603 T1252 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11603 T1252 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37212/i_d/ql collection:collection1 shard:shard1
[junit4:junit4]   2> 11608 T1252 oasc.ZkController.register We are http://127.0.0.1:37212/i_d/ql/collection1/ and leader is http://127.0.0.1:37198/i_d/ql/collection1/
[junit4:junit4]   2> 11608 T1252 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37212/i_d/ql
[junit4:junit4]   2> 11609 T1252 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11609 T1252 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C106 name=collection1 org.apache.solr.core.SolrCore@3e88262b url=http://127.0.0.1:37212/i_d/ql/collection1 node=127.0.0.1:37212_i_d%2Fql C106_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:37212_i_d%2Fql, base_url=http://127.0.0.1:37212/i_d/ql}
[junit4:junit4]   2> 11609 T1254 C106 P37212 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11610 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11611 T1254 C106 P37212 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11611 T1252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11611 T1254 C106 P37212 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11612 T1179 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 11612 T1254 C106 P37212 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11612 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11613 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11793 T1179 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11796 T1179 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37217
[junit4:junit4]   2> 11797 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11798 T1179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11798 T1179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661
[junit4:junit4]   2> 11798 T1179 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/solr.xml
[junit4:junit4]   2> 11799 T1179 oasc.CoreContainer.<init> New CoreContainer 1298734311
[junit4:junit4]   2> 11800 T1179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/'
[junit4:junit4]   2> 11800 T1179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/'
[junit4:junit4]   2> 11843 T1179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 11843 T1179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11844 T1179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11844 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11845 T1179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11845 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11846 T1179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11846 T1179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11846 T1179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11847 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11866 T1179 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11884 T1179 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:37189/solr
[junit4:junit4]   2> 11885 T1179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11886 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@53c93e75
[junit4:junit4]   2> 11887 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11887 T1264 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11888 T1264 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 11888 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37218
[junit4:junit4]   2> 11889 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37218
[junit4:junit4]   2> 11890 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a000b with negotiated timeout 20000 for client /140.211.11.196:37218
[junit4:junit4]   2> 11890 T1264 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a000b, negotiated timeout = 20000
[junit4:junit4]   2> 11891 T1265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53c93e75 name:ZooKeeperConnection Watcher:127.0.0.1:37189 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11891 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11893 T1184 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9c79b76a000b
[junit4:junit4]   2> 11916 T1265 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11916 T1181 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37218 which had sessionid 0x13c9c79b76a000b
[junit4:junit4]   2> 11916 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a000b closed
[junit4:junit4]   2> 11917 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 11926 T1179 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:37189/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@484e20a1
[junit4:junit4]   2> 11927 T1179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11927 T1266 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11928 T1266 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:37189, initiating session
[junit4:junit4]   2> 11928 T1181 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37219
[junit4:junit4]   2> 11929 T1181 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37219
[junit4:junit4]   2> 11930 T1183 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9c79b76a000c with negotiated timeout 20000 for client /140.211.11.196:37219
[junit4:junit4]   2> 11930 T1266 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:37189, sessionid = 0x13c9c79b76a000c, negotiated timeout = 20000
[junit4:junit4]   2> 11930 T1267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@484e20a1 name:ZooKeeperConnection Watcher:127.0.0.1:37189/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11930 T1179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11932 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a000c type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11933 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a000c type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11964 T1179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37217_i_d%2Fql
[junit4:junit4]   2> 11965 T1184 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9c79b76a000c type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37217_i_d%2Fql Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37217_i_d%2Fql
[junit4:junit4]   2> 11966 T1179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37217_i_d%2Fql
[junit4:junit4]   2> 11969 T1251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11969 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11969 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11970 T1201 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 11970 T1220 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 11970 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11970 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11972 T1251 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 11972 T1235 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 11973 T1207 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 11975 T1179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 11982 T1268 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/collection1
[junit4:junit4]   2> 11982 T1268 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 11983 T1268 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 11984 T1268 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 11985 T1268 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/collection1/'
[junit4:junit4]   2> 11986 T1268 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 11987 T1268 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/collection1/lib/README' to classloader
[junit4:junit4]   2> 12039 T1268 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 12112 T1268 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2>  C105_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:37202_i_d%2Fql, base_url=http://127.0.0.1:37202/i_d/ql}
[junit4:junit4]   2> 12213 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37198/i_d/ql/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 12213 T1268 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12213 T1238 C105 P37202 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37202/i_d/ql START replicas=[http://127.0.0.1:37198/i_d/ql/collection1/] nUpdates=100
[junit4:junit4]   2> 12214 T1238 C105 P37202 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 12215 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 12215 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 12215 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 12215 T1238 C105 P37202 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12215 T1238 C105 P37202 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37198/i_d/ql/collection1/. core=collection1
[junit4:junit4]   2> 12216 T1238 C105 P37202 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12220 T1268 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> ASYNC  NEW_CORE C107 name=collection1 org.apache.solr.core.SolrCore@7cfee4d3 url=http://127.0.0.1:37198/i_d/ql/collection1 node=127.0.0.1:37198_i_d%2Fql C107_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:37198_i_d%2Fql, base_url=http://127.0.0.1:37198/i_d/ql, leader=true}
[junit4:junit4]   2> 12223 T1212 C107 P37198 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 12231 T1213 C107 P37198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12233 T1213 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 12237 T1213 C107 P37198 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12238 T1213 C107 P37198 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 12245 T1213 C107 P37198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12246 T1213 C107 P37198 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12247 T1213 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 12248 T1213 C107 P37198 oass.SolrIndexSearcher.<init> Opening Searcher@40d9be9f realtime
[junit4:junit4]   2> 12248 T1213 C107 P37198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12249 T1213 C107 P37198 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4]   2> 12250 T1238 C105 P37202 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12250 T1238 C105 P37202 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12252 T1214 C107 P37198 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12252 T1214 C107 P37198 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12253 T1238 C105 P37202 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 12253 T1238 C105 P37202 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 12253 T1238 C105 P37202 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 12255 T1214 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 12256 T1214 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index
[junit4:junit4]   2> 12256 T1214 C107 P37198 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12257 T1238 C105 P37202 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 12258 T1238 C105 P37202 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291 forceNew:false
[junit4:junit4]   2> 12259 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12260 T1238 C105 P37202 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3400641d; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 12263 T1214 C107 P37198 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 12264 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index
[junit4:junit4]   2> 12265 T1238 C105 P37202 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12265 T1238 C105 P37202 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130202225500291
[junit4:junit4]   2> 12267 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12267 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12268 T1238 C105 P37202 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291
[junit4:junit4]   2> 12271 T1238 C105 P37202 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3400641d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12272 T1238 C105 P37202 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12273 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12274 T1238 C105 P37202 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 12274 T1238 C105 P37202 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 12274 T1238 C105 P37202 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 12275 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291
[junit4:junit4]   2> 12276 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12280 T1238 C105 P37202 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3400641d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12280 T1238 C105 P37202 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12280 T1238 C105 P37202 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 12281 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12281 T1238 C105 P37202 oass.SolrIndexSearcher.<init> Opening Searcher@2904f99d main
[junit4:junit4]   2> 12284 T1237 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2904f99d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 12284 T1237 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index
[junit4:junit4]   2> 12285 T1238 C105 P37202 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12289 T1238 C105 P37202 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3400641d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3400641d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 12289 T1238 C105 P37202 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 12290 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2
[junit4:junit4]   2> 12291 T1238 C105 P37202 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12291 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index.20130202225500291
[junit4:junit4]   2> 12291 T1238 C105 P37202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty2/index
[junit4:junit4]   2> 12291 T1238 C105 P37202 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 12291 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 12292 T1238 C105 P37202 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12292 T1238 C105 P37202 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12299 T1238 C105 P37202 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 12858 T1268 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 12869 T1268 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 12873 T1268 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 12888 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12889 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37212_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37212/i_d/ql"}
[junit4:junit4]   2> 12931 T1268 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 12934 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37202_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37202/i_d/ql"}
[junit4:junit4]   2> 12942 T1268 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 12948 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12953 T1268 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 12953 T1251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12954 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12953 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12953 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12948 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12956 T1268 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 12958 T1268 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359834899661/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/
[junit4:junit4]   2> 12958 T1268 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b478a2d
[junit4:junit4]   2> 12959 T1268 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 12960 T1268 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4 forceNew:false
[junit4:junit4]   2> 12960 T1268 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 12961 T1268 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index/
[junit4:junit4]   2> 12961 T1268 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 12962 T1268 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index forceNew:false
[junit4:junit4]   2> 12968 T1268 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffb4985; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12968 T1268 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 12969 T1268 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index
[junit4:junit4]   2> 12969 T1268 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 12971 T1268 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 12972 T1268 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 12972 T1268 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 12972 T1268 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 12973 T1268 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 12973 T1268 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 12973 T1268 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 12974 T1268 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 12975 T1268 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 12975 T1268 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 12976 T1268 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 12976 T1268 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 12977 T1268 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 12977 T1268 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 12977 T1268 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 12978 T1268 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 12978 T1268 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12979 T1268 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12979 T1268 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12980 T1268 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12980 T1268 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12981 T1268 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12981 T1268 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12982 T1268 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12982 T1268 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 12983 T1268 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 12990 T1268 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 12995 T1268 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 12996 T1268 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 12998 T1268 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 13000 T1268 oass.SolrIndexSearcher.<init> Opening Searcher@3d898ee3 main
[junit4:junit4]   2> 13001 T1268 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13001 T1268 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13002 T1268 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 13008 T1268 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 13072 T1271 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d898ee3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13077 T1268 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13077 T1268 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14462 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14463 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37217_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37217/i_d/ql"}
[junit4:junit4]   2> 14463 T1202 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14463 T1202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14493 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14493 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14493 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14493 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14493 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14493 T1251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15081 T1268 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15081 T1268 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37217/i_d/ql collection:collection1 shard:shard1
[junit4:junit4]   2> 15085 T1268 oasc.ZkController.register We are http://127.0.0.1:37217/i_d/ql/collection1/ and leader is http://127.0.0.1:37198/i_d/ql/collection1/
[junit4:junit4]   2> 15085 T1268 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37217/i_d/ql
[junit4:junit4]   2> 15086 T1268 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 15086 T1268 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C108 name=collection1 org.apache.solr.core.SolrCore@2587053f url=http://127.0.0.1:37217/i_d/ql/collection1 node=127.0.0.1:37217_i_d%2Fql C108_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:37217_i_d%2Fql, base_url=http://127.0.0.1:37217/i_d/ql}
[junit4:junit4]   2> 15087 T1272 C108 P37217 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 15088 T1272 C108 P37217 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 15088 T1268 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15088 T1272 C108 P37217 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 15088 T1272 C108 P37217 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15089 T1179 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 15090 T1272 C108 P37217 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15090 T1179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15090 T1179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15105 T1179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15107 T1179 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 15107 T1179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 15108 T1179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C106_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:37212_i_d%2Fql, base_url=http://127.0.0.1:37212/i_d/ql}
[junit4:junit4]   2> 15631 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37198/i_d/ql/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15631 T1254 C106 P37212 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37212/i_d/ql START replicas=[http://127.0.0.1:37198/i_d/ql/collection1/] nUpdates=100
[junit4:junit4]   2> 15632 T1254 C106 P37212 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15632 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15632 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15632 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15632 T1254 C106 P37212 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15632 T1254 C106 P37212 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37198/i_d/ql/collection1/. core=collection1
[junit4:junit4]   2> 15633 T1254 C106 P37212 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15634 T1212 C107 P37198 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 15642 T1216 C107 P37198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15648 T1216 C107 P37198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 15649 T1216 C107 P37198 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 15650 T1216 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 15650 T1216 C107 P37198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15650 T1216 C107 P37198 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4]   2> 15651 T1254 C106 P37212 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15651 T1254 C106 P37212 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 15654 T1214 C107 P37198 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 15655 T1254 C106 P37212 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 15655 T1254 C106 P37212 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 15655 T1254 C106 P37212 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 15657 T1214 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 15658 T1214 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index
[junit4:junit4]   2> 15659 T1214 C107 P37198 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15659 T1254 C106 P37212 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 15661 T1254 C106 P37212 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694 forceNew:false
[junit4:junit4]   2> 15661 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15662 T1254 C106 P37212 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1e8e8a; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 15666 T1214 C107 P37198 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   2> 15668 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index
[junit4:junit4]   2> 15668 T1254 C106 P37212 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 15668 T1254 C106 P37212 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130202225503694
[junit4:junit4]   2> 15670 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15670 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15670 T1254 C106 P37212 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694
[junit4:junit4]   2> 15674 T1254 C106 P37212 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1e8e8a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 15674 T1254 C106 P37212 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 15676 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15676 T1254 C106 P37212 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 15676 T1254 C106 P37212 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 15676 T1254 C106 P37212 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 15677 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694
[junit4:junit4]   2> 15678 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15681 T1254 C106 P37212 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1e8e8a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 15681 T1254 C106 P37212 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 15682 T1254 C106 P37212 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 15682 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15683 T1254 C106 P37212 oass.SolrIndexSearcher.<init> Opening Searcher@7b58bfbd main
[junit4:junit4]   2> 15685 T1253 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b58bfbd main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 15686 T1253 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index
[junit4:junit4]   2> 15686 T1254 C106 P37212 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15699 T1254 C106 P37212 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1e8e8a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1e8e8a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 15699 T1254 C106 P37212 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 15700 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3
[junit4:junit4]   2> 15701 T1254 C106 P37212 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15701 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index.20130202225503694
[junit4:junit4]   2> 15701 T1254 C106 P37212 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty3/index
[junit4:junit4]   2> 15701 T1254 C106 P37212 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 15701 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 15702 T1254 C106 P37212 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15702 T1254 C106 P37212 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15713 T1254 C106 P37212 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 15999 T1202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16000 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37217_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37217/i_d/ql"}
[junit4:junit4]   2> 16005 T1202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37212_i_d%2Fql",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37212/i_d/ql"}
[junit4:junit4]   2> 16017 T1235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16110 T1179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17113 T1179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C108_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:37217_i_d%2Fql, base_url=http://127.0.0.1:37217/i_d/ql}
[junit4:junit4]   2> 18108 T1272 C108 P37217 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37198/i_d/ql/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18108 T1272 C108 P37217 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37217/i_d/ql START replicas=[http://127.0.0.1:37198/i_d/ql/collection1/] nUpdates=100
[junit4:junit4]   2> 18109 T1272 C108 P37217 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18109 T1272 C108 P37217 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18109 T1272 C108 P37217 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18109 T1272 C108 P37217 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18109 T1272 C108 P37217 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18109 T1272 C108 P37217 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37198/i_d/ql/collection1/. core=collection1
[junit4:junit4]   2> 18110 T1272 C108 P37217 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18111 T1212 C107 P37198 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18115 T1179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18125 T1210 C107 P37198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18129 T1210 C107 P37198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c5fdf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 18130 T1210 C107 P37198 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 18131 T1210 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 18131 T1210 C107 P37198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18131 T1210 C107 P37198 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 18132 T1272 C108 P37217 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18132 T1272 C108 P37217 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18135 T1214 C107 P37198 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18136 T1272 C108 P37217 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 18136 T1272 C108 P37217 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18136 T1272 C108 P37217 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18139 T1214 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1
[junit4:junit4]   2> 18140 T1214 C107 P37198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty1/index
[junit4:junit4]   2> 18141 T1214 C107 P37198 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=2 
[junit4:junit4]   2> 18142 T1272 C108 P37217 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18143 T1272 C108 P37217 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index.20130202225506176 forceNew:false
[junit4:junit4]   2> 18144 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 18145 T1272 C108 P37217 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index.20130202225506176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22c5480; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 18148 T1214 C107 P37198 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 18150 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index
[junit4:junit4]   2> 18150 T1272 C108 P37217 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18151 T1272 C108 P37217 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130202225506176
[junit4:junit4]   2> 18152 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 18153 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 18153 T1272 C108 P37217 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index.20130202225506176
[junit4:junit4]   2> 18156 T1272 C108 P37217 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index.20130202225506176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22c5480; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 18157 T1272 C108 P37217 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 18158 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 18158 T1272 C108 P37217 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 18159 T1272 C108 P37217 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 18159 T1272 C108 P37217 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 18160 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index.20130202225506176
[junit4:junit4]   2> 18160 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 18164 T1272 C108 P37217 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4/index.20130202225506176 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22c5480; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 18164 T1272 C108 P37217 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 18164 T1272 C108 P37217 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 18165 T1272 C108 P37217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 1816

[...truncated too long message...]

core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359834888038/jetty4
[junit4:junit4]   2> 145609 T1266 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:37189. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 164094 T1267 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 164094 T1179 oaz.ZooKeeper.close Session: 0x13c9c79b76a000c closed
[junit4:junit4]   2> 164096 T1179 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/i_d/ql,null}
[junit4:junit4]   2> 164346 T1179 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=6AA35BCDC70B7AFA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs_CZ -Dtests.timezone=Asia/Baghdad -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  164s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([6AA35BCDC70B7AFA:EB45D5D5B0541AC6]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 164367 T1179 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=MockFixedIntBlock(blockSize=1519), text=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Memory doPackFST= true), rnd_b=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=Asserting), timestamp=MockFixedIntBlock(blockSize=1519), a_t=MockFixedIntBlock(blockSize=1519), range_facet_sl=PostingsFormat(name=Asserting), range_facet_si=MockFixedIntBlock(blockSize=1519), other_tl1=PostingsFormat(name=Memory doPackFST= true), multiDefault=MockFixedIntBlock(blockSize=1519), a_si=PostingsFormat(name=Memory doPackFST= true)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=cs_CZ, timezone=Asia/Baghdad
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=151333704,total=430768128
[junit4:junit4]   2> NOTE: All tests run in this JVM: [DirectUpdateHandlerTest, TestOmitPositions, TestMergePolicyConfig, TestPropInject, BasicFunctionalityTest, TestSolrJ, TestLRUCache, PeerSyncTest, TestBinaryField, EchoParamsTest, QueryEqualityTest, UUIDFieldTest, DebugComponentTest, ClusterStateTest, HighlighterTest, TestCodecSupport, XsltUpdateRequestHandlerTest, TestDocSet, FileUtilsTest, DisMaxRequestHandlerTest, UpdateParamsTest, SuggesterTSTTest, StatelessScriptUpdateProcessorFactoryTest, TestPhraseSuggestions, TermVectorComponentTest, RecoveryZkTest, PrimitiveFieldTypeTest, OverseerCollectionProcessorTest, TestFunctionQuery, OpenExchangeRatesOrgProviderTest, TestCSVResponseWriter, RegexBoostProcessorTest, IndexReaderFactoryTest, TestSolrXMLSerializer, TestRealTimeGet, HardAutoCommitTest, URLClassifyProcessorTest, TestValueSourceCache, ShardRoutingCustomTest, XmlUpdateRequestHandlerTest, SolrIndexConfigTest, QueryParsingTest, LukeRequestHandlerTest, PrimUtilsTest, TestSurroundQueryParser, SoftAutoCommitTest, TestReplicationHandler, TestRTGBase, TestSolrDeletionPolicy2, TestDistributedGrouping, DOMUtilTest, TestReload, TermVectorComponentDistributedTest, IndexSchemaTest, TestAnalyzedSuggestions, TestPluginEnable, TestDFRSimilarityFactory, SyncSliceTest]
[junit4:junit4] Completed on J1 in 164.38s, 1 test, 1 failure <<< FAILURES!

[...truncated 453 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:841: There were test failures: 250 suites, 1041 tests, 1 failure, 23 ignored (5 assumptions)

Total time: 36 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1302 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1302/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 should have just been set up to be inconsistent - but it's still consistent

Stack Trace:
java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
	at __randomizedtesting.SeedInfo.seed([F40A0CACDC58ADC6:75EC82B4AB07CDFA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 7978 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T118 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 8 T118 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1359813457500
[junit4:junit4]   2> 9 T118 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 10 T119 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 13 T119 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 13 T119 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 14 T119 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 14 T119 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 16 T119 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 111 T118 oasc.ZkTestServer.run start zk server on port:53851
[junit4:junit4]   2> 115 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@271c537f
[junit4:junit4]   2> 116 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 117 T124 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 117 T124 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 118 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47278
[junit4:junit4]   2> 118 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47278
[junit4:junit4]   2> 119 T122 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 148 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640000 with negotiated timeout 10000 for client /140.211.11.196:47278
[junit4:junit4]   2> 148 T124 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640000, negotiated timeout = 10000
[junit4:junit4]   2> 149 T125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@271c537f name:ZooKeeperConnection Watcher:127.0.0.1:53851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 149 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 150 T118 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 155 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b6640000
[junit4:junit4]   2> 156 T125 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 157 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:47278 which had sessionid 0x13c9b32b6640000
[junit4:junit4]   2> 156 T118 oaz.ZooKeeper.close Session: 0x13c9b32b6640000 closed
[junit4:junit4]   2> 157 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2587b08d
[junit4:junit4]   2> 158 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 159 T126 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 159 T126 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 160 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52174
[junit4:junit4]   2> 160 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52174
[junit4:junit4]   2> 162 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640001 with negotiated timeout 10000 for client /140.211.11.196:52174
[junit4:junit4]   2> 162 T126 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640001, negotiated timeout = 10000
[junit4:junit4]   2> 163 T127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2587b08d name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 163 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 164 T118 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 171 T118 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 176 T118 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 180 T118 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 187 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 188 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 202 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 203 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 310 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 311 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 316 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 316 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 325 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 326 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 331 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 332 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 337 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 337 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 342 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 343 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 348 T118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 349 T118 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 354 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b6640001
[junit4:junit4]   2> 355 T127 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 355 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52174 which had sessionid 0x13c9b32b6640001
[junit4:junit4]   2> 355 T118 oaz.ZooKeeper.close Session: 0x13c9b32b6640001 closed
[junit4:junit4]   2> 524 T118 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 529 T118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:26150
[junit4:junit4]   2> 530 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 531 T118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 532 T118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848
[junit4:junit4]   2> 532 T118 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/solr.xml
[junit4:junit4]   2> 533 T118 oasc.CoreContainer.<init> New CoreContainer 430771672
[junit4:junit4]   2> 533 T118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/'
[junit4:junit4]   2> 534 T118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/'
[junit4:junit4]   2> 578 T118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 579 T118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 580 T118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 580 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 581 T118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 581 T118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 582 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 582 T118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 583 T118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 583 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 608 T118 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 630 T118 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53851/solr
[junit4:junit4]   2> 630 T118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 631 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7e1eb84f
[junit4:junit4]   2> 632 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 633 T137 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 634 T137 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 634 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:50830
[junit4:junit4]   2> 634 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:50830
[junit4:junit4]   2> 636 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640002 with negotiated timeout 20000 for client /140.211.11.196:50830
[junit4:junit4]   2> 637 T137 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640002, negotiated timeout = 20000
[junit4:junit4]   2> 637 T138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e1eb84f name:ZooKeeperConnection Watcher:127.0.0.1:53851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 637 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 639 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b6640002
[junit4:junit4]   2> 641 T138 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 641 T118 oaz.ZooKeeper.close Session: 0x13c9b32b6640002 closed
[junit4:junit4]   2> 641 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:50830 which had sessionid 0x13c9b32b6640002
[junit4:junit4]   2> 642 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 655 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@792bf678
[junit4:junit4]   2> 656 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 656 T139 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 657 T139 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 657 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23829
[junit4:junit4]   2> 658 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23829
[junit4:junit4]   2> 659 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640003 with negotiated timeout 20000 for client /140.211.11.196:23829
[junit4:junit4]   2> 659 T139 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640003, negotiated timeout = 20000
[junit4:junit4]   2> 660 T140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@792bf678 name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 660 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 663 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 671 T118 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 674 T118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:26150_
[junit4:junit4]   2> 675 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:26150_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:26150_
[junit4:junit4]   2> 677 T118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:26150_
[junit4:junit4]   2> 687 T118 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 718 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 720 T118 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 724 T118 oasc.Overseer.start Overseer (id=89116734751244291-127.0.0.1:26150_-n_0000000000) starting
[junit4:junit4]   2> 725 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 732 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 734 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 736 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 743 T142 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 744 T118 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 755 T118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 758 T141 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 764 T143 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/collection1
[junit4:junit4]   2> 764 T143 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 765 T143 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 765 T143 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 767 T143 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/collection1/'
[junit4:junit4]   2> 769 T143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 770 T143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/collection1/lib/README' to classloader
[junit4:junit4]   2> 825 T143 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 902 T143 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1004 T143 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1012 T143 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1614 T143 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1623 T143 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1625 T143 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1645 T143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1650 T143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1654 T143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1656 T143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1658 T143 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1359813457848/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data/
[junit4:junit4]   2> 1658 T143 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@112c3327
[junit4:junit4]   2> 1659 T143 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1682 T143 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data forceNew:false
[junit4:junit4]   2> 1683 T143 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data
[junit4:junit4]   2> 1683 T143 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data/index/
[junit4:junit4]   2> 1684 T143 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1686 T143 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data/index forceNew:false
[junit4:junit4]   2> 1716 T143 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a6af2fb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1716 T143 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1717 T143 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data/index
[junit4:junit4]   2> 1717 T143 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1719 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1719 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1719 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1720 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1720 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1721 T143 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1721 T143 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1721 T143 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1722 T143 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1722 T143 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1723 T143 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1723 T143 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1724 T143 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1724 T143 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1724 T143 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1725 T143 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1725 T143 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1725 T143 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1726 T143 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1726 T143 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1727 T143 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1727 T143 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1728 T143 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1728 T143 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1729 T143 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1729 T143 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1734 T143 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1737 T143 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1739 T143 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1740 T143 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/control/data
[junit4:junit4]   2> 1742 T143 oass.SolrIndexSearcher.<init> Opening Searcher@91bee48 main
[junit4:junit4]   2> 1743 T143 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1743 T143 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1743 T143 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1759 T143 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1806 T144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@91bee48 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1811 T143 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1812 T143 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1812 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2264 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2265 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:26150_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:26150"}
[junit4:junit4]   2> 2265 T141 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2274 T141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2275 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2299 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2825 T143 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2825 T143 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:26150 collection:control_collection shard:shard1
[junit4:junit4]   2> 2826 T143 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2847 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2848 T143 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2849 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2858 T143 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2859 T143 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2859 T143 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:26150/collection1/
[junit4:junit4]   2> 2859 T143 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2860 T143 oasc.SyncStrategy.syncToMe http://127.0.0.1:26150/collection1/ has no replicas
[junit4:junit4]   2> 2860 T143 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:26150/collection1/
[junit4:junit4]   2> 2860 T143 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2867 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3805 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3833 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3890 T143 oasc.ZkController.register We are http://127.0.0.1:26150/collection1/ and leader is http://127.0.0.1:26150/collection1/
[junit4:junit4]   2> 3890 T143 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:26150
[junit4:junit4]   2> 3890 T143 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3891 T143 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3891 T143 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3893 T143 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3895 T118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3895 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3896 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3912 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3928 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@399c123d
[junit4:junit4]   2> 3929 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3930 T145 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3931 T145 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 3931 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18136
[junit4:junit4]   2> 3931 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18136
[junit4:junit4]   2> 3933 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640004 with negotiated timeout 10000 for client /140.211.11.196:18136
[junit4:junit4]   2> 3933 T145 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640004, negotiated timeout = 10000
[junit4:junit4]   2> 3933 T146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@399c123d name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3934 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3935 T118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3940 T118 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4104 T118 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4106 T118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14804
[junit4:junit4]   2> 4107 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4108 T118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4108 T118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431
[junit4:junit4]   2> 4109 T118 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/solr.xml
[junit4:junit4]   2> 4109 T118 oasc.CoreContainer.<init> New CoreContainer 217690909
[junit4:junit4]   2> 4110 T118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/'
[junit4:junit4]   2> 4111 T118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/'
[junit4:junit4]   2> 4153 T118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 4153 T118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4154 T118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4154 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4155 T118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4155 T118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4156 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4156 T118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4157 T118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4158 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4178 T118 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4198 T118 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53851/solr
[junit4:junit4]   2> 4199 T118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4199 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@55991e21
[junit4:junit4]   2> 4200 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4201 T156 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4202 T156 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 4202 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53872
[junit4:junit4]   2> 4202 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53872
[junit4:junit4]   2> 4205 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640005 with negotiated timeout 20000 for client /140.211.11.196:53872
[junit4:junit4]   2> 4205 T156 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640005, negotiated timeout = 20000
[junit4:junit4]   2> 4205 T157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55991e21 name:ZooKeeperConnection Watcher:127.0.0.1:53851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4206 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4207 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b6640005
[junit4:junit4]   2> 4223 T157 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4223 T118 oaz.ZooKeeper.close Session: 0x13c9b32b6640005 closed
[junit4:junit4]   2> 4223 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:53872 which had sessionid 0x13c9b32b6640005
[junit4:junit4]   2> 4224 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 4234 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1558c52c
[junit4:junit4]   2> 4236 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4236 T158 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4237 T158 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 4237 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:56020
[junit4:junit4]   2> 4238 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:56020
[junit4:junit4]   2> 4239 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640006 with negotiated timeout 20000 for client /140.211.11.196:56020
[junit4:junit4]   2> 4239 T158 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640006, negotiated timeout = 20000
[junit4:junit4]   2> 4240 T159 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1558c52c name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4240 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4241 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4243 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4251 T118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14804_
[junit4:junit4]   2> 4252 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:14804_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:14804_
[junit4:junit4]   2> 4253 T118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14804_
[junit4:junit4]   2> 4257 T140 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4258 T146 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4258 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4267 T118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4281 T160 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/collection1
[junit4:junit4]   2> 4282 T160 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4283 T160 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4284 T160 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4286 T160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/collection1/'
[junit4:junit4]   2> 4287 T160 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4288 T160 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/collection1/lib/README' to classloader
[junit4:junit4]   2> 4344 T160 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 4419 T160 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4520 T160 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4528 T160 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5120 T160 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5128 T160 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5130 T160 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5150 T160 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5155 T160 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5158 T160 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5160 T160 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5162 T160 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1359813461431/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/
[junit4:junit4]   2> 5163 T160 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@112c3327
[junit4:junit4]   2> 5163 T160 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5164 T160 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1 forceNew:false
[junit4:junit4]   2> 5165 T160 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 5165 T160 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index/
[junit4:junit4]   2> 5165 T160 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5166 T160 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index forceNew:false
[junit4:junit4]   2> 5198 T160 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5198 T160 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5199 T160 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index
[junit4:junit4]   2> 5199 T160 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5205 T160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5205 T160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5205 T160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5206 T160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5206 T160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5207 T160 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5207 T160 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5207 T160 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5208 T160 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5209 T160 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5209 T160 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5209 T160 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5210 T160 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5210 T160 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5211 T160 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5211 T160 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5212 T160 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5212 T160 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5213 T160 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5213 T160 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5214 T160 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5214 T160 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5215 T160 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5215 T160 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5216 T160 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5216 T160 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5221 T160 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5224 T160 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5225 T160 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5227 T160 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 5229 T160 oass.SolrIndexSearcher.<init> Opening Searcher@3de70e12 main
[junit4:junit4]   2> 5230 T160 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5230 T160 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5230 T160 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5235 T160 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5284 T161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3de70e12 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5289 T160 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5289 T160 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5347 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5348 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:26150_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:26150"}
[junit4:junit4]   2> 5353 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:14804_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:14804"}
[junit4:junit4]   2> 5354 T141 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 5354 T141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5365 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5365 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5365 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6292 T160 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6292 T160 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14804 collection:collection1 shard:shard1
[junit4:junit4]   2> 6293 T160 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6318 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6319 T160 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6320 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6428 T160 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6429 T160 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6429 T160 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:14804/collection1/
[junit4:junit4]   2> 6429 T160 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6430 T160 oasc.SyncStrategy.syncToMe http://127.0.0.1:14804/collection1/ has no replicas
[junit4:junit4]   2> 6430 T160 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:14804/collection1/
[junit4:junit4]   2> 6430 T160 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6437 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6881 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6903 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6903 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6903 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6950 T160 oasc.ZkController.register We are http://127.0.0.1:14804/collection1/ and leader is http://127.0.0.1:14804/collection1/
[junit4:junit4]   2> 6950 T160 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14804
[junit4:junit4]   2> 6950 T160 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6950 T160 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6951 T160 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6953 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6955 T118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 6955 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6956 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7133 T118 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7136 T118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29369
[junit4:junit4]   2> 7137 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7138 T118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7138 T118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462
[junit4:junit4]   2> 7139 T118 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/solr.xml
[junit4:junit4]   2> 7139 T118 oasc.CoreContainer.<init> New CoreContainer 1212229433
[junit4:junit4]   2> 7140 T118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/'
[junit4:junit4]   2> 7140 T118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/'
[junit4:junit4]   2> 7182 T118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 7183 T118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7183 T118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7184 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7184 T118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7185 T118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7185 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7186 T118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7186 T118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7187 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7209 T118 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7229 T118 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53851/solr
[junit4:junit4]   2> 7229 T118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7230 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2b5fe9c3
[junit4:junit4]   2> 7231 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7231 T171 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7232 T171 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 7233 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:26231
[junit4:junit4]   2> 7233 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:26231
[junit4:junit4]   2> 7236 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640007 with negotiated timeout 20000 for client /140.211.11.196:26231
[junit4:junit4]   2> 7236 T171 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640007, negotiated timeout = 20000
[junit4:junit4]   2> 7236 T172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b5fe9c3 name:ZooKeeperConnection Watcher:127.0.0.1:53851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7236 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7238 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b6640007
[junit4:junit4]   2> 7249 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:26231 which had sessionid 0x13c9b32b6640007
[junit4:junit4]   2> 7250 T172 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7250 T118 oaz.ZooKeeper.close Session: 0x13c9b32b6640007 closed
[junit4:junit4]   2> 7251 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 7264 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@789ddfa3
[junit4:junit4]   2> 7265 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7265 T173 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 7266 T173 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 7266 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:60059
[junit4:junit4]   2> 7267 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:60059
[junit4:junit4]   2> 7268 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640008 with negotiated timeout 20000 for client /140.211.11.196:60059
[junit4:junit4]   2> 7268 T173 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640008, negotiated timeout = 20000
[junit4:junit4]   2> 7269 T174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@789ddfa3 name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7269 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7270 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7272 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7279 T118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29369_
[junit4:junit4]   2> 7280 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b6640008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:29369_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:29369_
[junit4:junit4]   2> 7281 T118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29369_
[junit4:junit4]   2> 7285 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7285 T140 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7286 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7286 T159 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7286 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7288 T146 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7291 T118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7299 T175 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/collection1
[junit4:junit4]   2> 7299 T175 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7300 T175 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7300 T175 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7302 T175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/collection1/'
[junit4:junit4]   2> 7304 T175 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7304 T175 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/collection1/lib/README' to classloader
[junit4:junit4]   2> 7361 T175 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 7434 T175 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7535 T175 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7543 T175 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8118 T175 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8128 T175 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8131 T175 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8173 T175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8177 T175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8181 T175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8183 T175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8185 T175 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1359813464462/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/
[junit4:junit4]   2> 8185 T175 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@112c3327
[junit4:junit4]   2> 8186 T175 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8186 T175 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2 forceNew:false
[junit4:junit4]   2> 8187 T175 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 8187 T175 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index/
[junit4:junit4]   2> 8188 T175 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8188 T175 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index forceNew:false
[junit4:junit4]   2> 8193 T175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bf7dab1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8193 T175 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8194 T175 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index
[junit4:junit4]   2> 8194 T175 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8197 T175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8197 T175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8197 T175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8198 T175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8198 T175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8198 T175 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8199 T175 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8199 T175 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8200 T175 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8200 T175 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8201 T175 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8201 T175 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8202 T175 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8202 T175 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8202 T175 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8203 T175 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8203 T175 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8204 T175 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8204 T175 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8205 T175 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8205 T175 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8206 T175 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8206 T175 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8207 T175 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8207 T175 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8208 T175 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8213 T175 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8216 T175 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8217 T175 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8219 T175 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 8220 T175 oass.SolrIndexSearcher.<init> Opening Searcher@36592bb1 main
[junit4:junit4]   2> 8221 T175 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8221 T175 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8221 T175 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8226 T175 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8274 T176 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36592bb1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8278 T175 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8278 T175 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8416 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8418 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:14804_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:14804"}
[junit4:junit4]   2> 8424 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29369_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29369"}
[junit4:junit4]   2> 8424 T141 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 8425 T141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8437 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8437 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8437 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8437 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9281 T175 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9281 T175 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29369 collection:collection1 shard:shard1
[junit4:junit4]   2> 9309 T175 oasc.ZkController.register We are http://127.0.0.1:29369/collection1/ and leader is http://127.0.0.1:14804/collection1/
[junit4:junit4]   2> 9309 T175 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29369
[junit4:junit4]   2> 9310 T175 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 9310 T175 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@12330301 url=http://127.0.0.1:29369/collection1 node=127.0.0.1:29369_ C8_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:29369_, base_url=http://127.0.0.1:29369}
[junit4:junit4]   2> 9317 T177 C8 P29369 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 9317 T175 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9318 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9319 T177 C8 P29369 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 9319 T177 C8 P29369 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9320 T118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 9320 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9321 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9327 T177 C8 P29369 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9504 T118 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9507 T118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11470
[junit4:junit4]   2> 9508 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9509 T118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9509 T118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831
[junit4:junit4]   2> 9510 T118 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/solr.xml
[junit4:junit4]   2> 9510 T118 oasc.CoreContainer.<init> New CoreContainer 1594130585
[junit4:junit4]   2> 9511 T118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/'
[junit4:junit4]   2> 9511 T118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/'
[junit4:junit4]   2> 9555 T118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 9555 T118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9556 T118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9556 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9557 T118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9557 T118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9558 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9558 T118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9559 T118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9559 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9582 T118 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9601 T118 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53851/solr
[junit4:junit4]   2> 9602 T118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9603 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14c55164
[junit4:junit4]   2> 9604 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9605 T187 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9605 T187 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 9606 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55702
[junit4:junit4]   2> 9606 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55702
[junit4:junit4]   2> 9614 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b6640009 with negotiated timeout 20000 for client /140.211.11.196:55702
[junit4:junit4]   2> 9614 T187 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b6640009, negotiated timeout = 20000
[junit4:junit4]   2> 9615 T188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14c55164 name:ZooKeeperConnection Watcher:127.0.0.1:53851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9615 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9617 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b6640009
[junit4:junit4]   2> 9626 T188 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9626 T118 oaz.ZooKeeper.close Session: 0x13c9b32b6640009 closed
[junit4:junit4]   2> 9626 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:55702 which had sessionid 0x13c9b32b6640009
[junit4:junit4]   2> 9627 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 9640 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@63d15d1c
[junit4:junit4]   2> 9641 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9641 T189 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9642 T189 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 9642 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:24965
[junit4:junit4]   2> 9643 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:24965
[junit4:junit4]   2> 9662 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b664000a with negotiated timeout 20000 for client /140.211.11.196:24965
[junit4:junit4]   2> 9662 T189 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b664000a, negotiated timeout = 20000
[junit4:junit4]   2> 9663 T190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63d15d1c name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9663 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9664 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b664000a type:create cxid:0x1 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9666 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b664000a type:create cxid:0x2 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9675 T118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11470_
[junit4:junit4]   2> 9676 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b664000a type:delete cxid:0x4 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:11470_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:11470_
[junit4:junit4]   2> 9684 T118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11470_
[junit4:junit4]   2> 9688 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9688 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9689 T140 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9689 T159 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9689 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9689 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9690 T146 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9691 T174 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9698 T118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9708 T191 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/collection1
[junit4:junit4]   2> 9708 T191 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9709 T191 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9709 T191 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9712 T191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/collection1/'
[junit4:junit4]   2> 9713 T191 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/collection1/lib/README' to classloader
[junit4:junit4]   2> 9714 T191 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9768 T191 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 9843 T191 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9945 T191 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9952 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9953 T191 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9954 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29369_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29369"}
[junit4:junit4]   2> 9969 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9969 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9969 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9969 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9969 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10590 T191 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10599 T191 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10602 T191 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10624 T191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10629 T191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10633 T191 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10635 T191 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10637 T191 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1359813466831/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/
[junit4:junit4]   2> 10637 T191 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@112c3327
[junit4:junit4]   2> 10637 T191 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10638 T191 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3 forceNew:false
[junit4:junit4]   2> 10639 T191 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 10639 T191 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index/
[junit4:junit4]   2> 10639 T191 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10640 T191 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index forceNew:false
[junit4:junit4]   2> 10645 T191 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@22f42d53; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10645 T191 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10646 T191 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index
[junit4:junit4]   2> 10646 T191 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10648 T191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10648 T191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10648 T191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10649 T191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10649 T191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10649 T191 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10650 T191 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10650 T191 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10651 T191 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10651 T191 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10652 T191 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10652 T191 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10653 T191 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10653 T191 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10653 T191 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10654 T191 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10654 T191 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10655 T191 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10656 T191 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10656 T191 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10657 T191 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10657 T191 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10658 T191 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10659 T191 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10659 T191 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10660 T191 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10665 T191 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10669 T191 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10671 T191 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 10673 T191 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 10674 T191 oass.SolrIndexSearcher.<init> Opening Searcher@1bfbafbb main
[junit4:junit4]   2> 10675 T191 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10675 T191 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10676 T191 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10691 T191 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 10747 T192 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1bfbafbb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10752 T191 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10752 T191 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11477 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11479 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:11470_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:11470"}
[junit4:junit4]   2> 11479 T141 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11480 T141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11493 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11493 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11493 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11493 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11493 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11755 T191 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11755 T191 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11470 collection:collection1 shard:shard1
[junit4:junit4]   2> 11760 T191 oasc.ZkController.register We are http://127.0.0.1:11470/collection1/ and leader is http://127.0.0.1:14804/collection1/
[junit4:junit4]   2> 11760 T191 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11470
[junit4:junit4]   2> 11760 T191 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11761 T191 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@2c618b08 url=http://127.0.0.1:11470/collection1 node=127.0.0.1:11470_ C9_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:11470_, base_url=http://127.0.0.1:11470}
[junit4:junit4]   2> 11761 T193 C9 P11470 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11762 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11762 T191 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11762 T193 C9 P11470 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11763 T193 C9 P11470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11763 T118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 11764 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11765 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11767 T193 C9 P11470 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11934 T118 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11937 T118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:56100
[junit4:junit4]   2> 11938 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11938 T118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11939 T118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275
[junit4:junit4]   2> 11939 T118 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/solr.xml
[junit4:junit4]   2> 11940 T118 oasc.CoreContainer.<init> New CoreContainer 1630011351
[junit4:junit4]   2> 11940 T118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/'
[junit4:junit4]   2> 11941 T118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/'
[junit4:junit4]   2> 11980 T118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4]   2> 11980 T118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11981 T118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11981 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11982 T118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11982 T118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11983 T118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11983 T118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11984 T118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11984 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12003 T118 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12021 T118 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53851/solr
[junit4:junit4]   2> 12022 T118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12022 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e6bb83
[junit4:junit4]   2> 12023 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12024 T203 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12025 T203 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 12025 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22967
[junit4:junit4]   2> 12025 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22967
[junit4:junit4]   2> 12027 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b664000b with negotiated timeout 20000 for client /140.211.11.196:22967
[junit4:junit4]   2> 12028 T203 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b664000b, negotiated timeout = 20000
[junit4:junit4]   2> 12028 T204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e6bb83 name:ZooKeeperConnection Watcher:127.0.0.1:53851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12028 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12030 T123 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c9b32b664000b
[junit4:junit4]   2> 12039 T204 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12039 T120 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22967 which had sessionid 0x13c9b32b664000b
[junit4:junit4]   2> 12039 T118 oaz.ZooKeeper.close Session: 0x13c9b32b664000b closed
[junit4:junit4]   2> 12040 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4]   2> 12051 T118 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53851/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b98a1f4
[junit4:junit4]   2> 12052 T118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12053 T205 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12053 T205 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53851, initiating session
[junit4:junit4]   2> 12054 T120 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52782
[junit4:junit4]   2> 12054 T120 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52782
[junit4:junit4]   2> 12056 T122 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c9b32b664000c with negotiated timeout 20000 for client /140.211.11.196:52782
[junit4:junit4]   2> 12056 T205 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53851, sessionid = 0x13c9b32b664000c, negotiated timeout = 20000
[junit4:junit4]   2> 12056 T206 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b98a1f4 name:ZooKeeperConnection Watcher:127.0.0.1:53851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12056 T118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12058 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b664000c type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12060 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b664000c type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12068 T118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56100_
[junit4:junit4]   2> 12068 T123 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c9b32b664000c type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56100_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56100_
[junit4:junit4]   2> 12070 T118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56100_
[junit4:junit4]   2> 12073 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12073 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12074 T159 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12074 T190 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12074 T140 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12074 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12074 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12074 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12076 T146 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12078 T174 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12080 T118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12087 T207 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/collection1
[junit4:junit4]   2> 12088 T207 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12089 T207 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12089 T207 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12091 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/collection1/'
[junit4:junit4]   2> 12092 T207 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12093 T207 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/collection1/lib/README' to classloader
[junit4:junit4]   2> 12170 T207 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4]   2> 12244 T207 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12345 T207 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12353 T207 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2>  C8_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:29369_, base_url=http://127.0.0.1:29369}
[junit4:junit4]   2> 12362 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14804/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 12362 T177 C8 P29369 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29369 START replicas=[http://127.0.0.1:14804/collection1/] nUpdates=100
[junit4:junit4]   2> 12363 T177 C8 P29369 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 12364 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 12364 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 12365 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 12365 T177 C8 P29369 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12366 T177 C8 P29369 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14804/collection1/. core=collection1
[junit4:junit4]   2> 12366 T177 C8 P29369 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@33dd66fd url=http://127.0.0.1:14804/collection1 node=127.0.0.1:14804_ C10_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14804_, base_url=http://127.0.0.1:14804, leader=true}
[junit4:junit4]   2> 12375 T151 C10 P14804 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 12397 T152 C10 P14804 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12398 T152 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 12404 T152 C10 P14804 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12404 T152 C10 P14804 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 12409 T152 C10 P14804 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12410 T152 C10 P14804 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12411 T152 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 12412 T152 C10 P14804 oass.SolrIndexSearcher.<init> Opening Searcher@33acf5f7 realtime
[junit4:junit4]   2> 12412 T152 C10 P14804 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12413 T152 C10 P14804 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 33
[junit4:junit4]   2> 12471 T177 C8 P29369 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12472 T177 C8 P29369 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 12498 T177 C8 P29369 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12502 T153 C10 P14804 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12503 T153 C10 P14804 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 12505 T177 C8 P29369 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 12506 T177 C8 P29369 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 12506 T177 C8 P29369 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 12509 T153 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 12510 T153 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index
[junit4:junit4]   2> 12511 T153 C10 P14804 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=3 
[junit4:junit4]   2> 12512 T177 C8 P29369 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 12514 T177 C8 P29369 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004 forceNew:false
[junit4:junit4]   2> 12514 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12515 T177 C8 P29369 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004 lockFactory=org.apache.lucene.store.NativeFSLockFactory@59a5d193; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 12529 T153 C10 P14804 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5 
[junit4:junit4]   2> 12543 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index
[junit4:junit4]   2> 12543 T177 C8 P29369 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12544 T177 C8 P29369 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203015750004
[junit4:junit4]   2> 12546 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12547 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12547 T177 C8 P29369 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004
[junit4:junit4]   2> 12551 T177 C8 P29369 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004 lockFactory=org.apache.lucene.store.NativeFSLockFactory@59a5d193; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12552 T177 C8 P29369 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12553 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12558 T177 C8 P29369 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 12558 T177 C8 P29369 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 12558 T177 C8 P29369 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 12559 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004
[junit4:junit4]   2> 12560 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12565 T177 C8 P29369 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004 lockFactory=org.apache.lucene.store.NativeFSLockFactory@59a5d193; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12565 T177 C8 P29369 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12565 T177 C8 P29369 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 12566 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12566 T177 C8 P29369 oass.SolrIndexSearcher.<init> Opening Searcher@6dffeaea main
[junit4:junit4]   2> 12569 T176 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6dffeaea main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 12569 T176 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index
[junit4:junit4]   2> 12570 T177 C8 P29369 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12574 T177 C8 P29369 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004 lockFactory=org.apache.lucene.store.NativeFSLockFactory@59a5d193; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004 lockFactory=org.apache.lucene.store.NativeFSLockFactory@59a5d193; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 12574 T177 C8 P29369 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 12575 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2
[junit4:junit4]   2> 12576 T177 C8 P29369 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12576 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index.20130203015750004
[junit4:junit4]   2> 12576 T177 C8 P29369 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty2/index
[junit4:junit4]   2> 12577 T177 C8 P29369 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 12577 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 12577 T177 C8 P29369 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12577 T177 C8 P29369 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12580 T177 C8 P29369 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 13001 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13002 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:11470_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:11470"}
[junit4:junit4]   2> 13009 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:29369_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:29369"}
[junit4:junit4]   2> 13027 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13027 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13027 T206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13027 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13027 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13027 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13077 T207 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13088 T207 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13092 T207 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13116 T207 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13126 T207 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13131 T207 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13133 T207 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13135 T207 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1359813469275/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/
[junit4:junit4]   2> 13135 T207 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@112c3327
[junit4:junit4]   2> 13136 T207 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13136 T207 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4 forceNew:false
[junit4:junit4]   2> 13137 T207 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 13137 T207 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index/
[junit4:junit4]   2> 13138 T207 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13139 T207 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index forceNew:false
[junit4:junit4]   2> 13144 T207 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e680525; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13145 T207 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13146 T207 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index
[junit4:junit4]   2> 13146 T207 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 13148 T207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13149 T207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 13149 T207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13150 T207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 13150 T207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13151 T207 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13151 T207 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13152 T207 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13152 T207 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13153 T207 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 13154 T207 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 13154 T207 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13155 T207 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 13155 T207 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 13156 T207 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 13156 T207 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13157 T207 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13158 T207 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13158 T207 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13159 T207 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13160 T207 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13160 T207 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13161 T207 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13162 T207 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13162 T207 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 13163 T207 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 13170 T207 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13174 T207 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 13176 T207 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 13178 T207 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 13180 T207 oass.SolrIndexSearcher.<init> Opening Searcher@10e89338 main
[junit4:junit4]   2> 13181 T207 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13181 T207 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13182 T207 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 13188 T207 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 13250 T210 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10e89338 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13256 T207 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13256 T207 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14538 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14540 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56100_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56100"}
[junit4:junit4]   2> 14540 T141 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14540 T141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14613 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14613 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14613 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14613 T206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14613 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14613 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15261 T207 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15261 T207 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56100 collection:collection1 shard:shard1
[junit4:junit4]   2> 15267 T207 oasc.ZkController.register We are http://127.0.0.1:56100/collection1/ and leader is http://127.0.0.1:14804/collection1/
[junit4:junit4]   2> 15267 T207 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56100
[junit4:junit4]   2> 15267 T207 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 15268 T207 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@357b7c1 url=http://127.0.0.1:56100/collection1 node=127.0.0.1:56100_ C11_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56100_, base_url=http://127.0.0.1:56100}
[junit4:junit4]   2> 15268 T211 C11 P56100 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 15269 T211 C11 P56100 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 15269 T207 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15270 T211 C11 P56100 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 15270 T211 C11 P56100 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15271 T118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 15272 T118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15272 T211 C11 P56100 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15272 T118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15292 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15295 T118 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 15295 T118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 15296 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C9_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:11470_, base_url=http://127.0.0.1:11470}
[junit4:junit4]   2> 15789 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14804/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15789 T193 C9 P11470 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:11470 START replicas=[http://127.0.0.1:14804/collection1/] nUpdates=100
[junit4:junit4]   2> 15849 T193 C9 P11470 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 16327 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 16327 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 16328 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 16328 T193 C9 P11470 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 16328 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16328 T193 C9 P11470 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14804/collection1/. core=collection1
[junit4:junit4]   2> 16329 T193 C9 P11470 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16330 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16330 T151 C10 P14804 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16343 T155 C10 P14804 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16356 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:56100_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:56100"}
[junit4:junit4]   2> 16370 T155 C10 P14804 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16371 T155 C10 P14804 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16372 T155 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 16372 T155 C10 P14804 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16372 T155 C10 P14804 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4]   2> 16374 T193 C9 P11470 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16374 T193 C9 P11470 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 16378 T153 C10 P14804 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16379 T193 C9 P11470 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 16379 T193 C9 P11470 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 16379 T193 C9 P11470 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 16381 T153 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 16382 T153 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index
[junit4:junit4]   2> 16382 T153 C10 P14804 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16383 T193 C9 P11470 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 16384 T193 C9 P11470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875 forceNew:false
[junit4:junit4]   2> 16385 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16386 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16386 T193 C9 P11470 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f0e0edb; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 16386 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16386 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16386 T206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16386 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16386 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16391 T153 C10 P14804 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=1 
[junit4:junit4]   2> 16392 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index
[junit4:junit4]   2> 16393 T193 C9 P11470 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 16399 T193 C9 P11470 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203015753875
[junit4:junit4]   2> 16401 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16402 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16402 T193 C9 P11470 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875
[junit4:junit4]   2> 16406 T193 C9 P11470 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f0e0edb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16406 T193 C9 P11470 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16408 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16408 T193 C9 P11470 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 16409 T193 C9 P11470 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 16409 T193 C9 P11470 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 16410 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875
[junit4:junit4]   2> 16411 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16414 T193 C9 P11470 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f0e0edb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16415 T193 C9 P11470 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16415 T193 C9 P11470 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 16416 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16416 T193 C9 P11470 oass.SolrIndexSearcher.<init> Opening Searcher@799ac2e3 main
[junit4:junit4]   2> 16418 T192 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@799ac2e3 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 16419 T192 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index
[junit4:junit4]   2> 16419 T193 C9 P11470 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16433 T193 C9 P11470 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f0e0edb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f0e0edb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 16433 T193 C9 P11470 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 16434 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3
[junit4:junit4]   2> 16434 T193 C9 P11470 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16434 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index.20130203015753875
[junit4:junit4]   2> 16435 T193 C9 P11470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty3/index
[junit4:junit4]   2> 16435 T193 C9 P11470 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 16435 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 16435 T193 C9 P11470 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 16435 T193 C9 P11470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16444 T193 C9 P11470 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 17332 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17895 T141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17896 T141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:11470_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:11470"}
[junit4:junit4]   2> 17910 T190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17910 T159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17910 T206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17910 T174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17910 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17910 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18335 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C11_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56100_, base_url=http://127.0.0.1:56100}
[junit4:junit4]   2> 19328 T211 C11 P56100 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14804/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 19328 T211 C11 P56100 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56100 START replicas=[http://127.0.0.1:14804/collection1/] nUpdates=100
[junit4:junit4]   2> 19329 T211 C11 P56100 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19329 T211 C11 P56100 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 19329 T211 C11 P56100 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 19329 T211 C11 P56100 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 19329 T211 C11 P56100 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19330 T211 C11 P56100 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14804/collection1/. core=collection1
[junit4:junit4]   2> 19330 T211 C11 P56100 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19332 T151 C10 P14804 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 19337 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19342 T149 C10 P14804 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 19345 T149 C10 P14804 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19166179; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 19346 T149 C10 P14804 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 19346 T149 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 19346 T149 C10 P14804 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19347 T149 C10 P14804 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4]   2> 19348 T211 C11 P56100 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19348 T211 C11 P56100 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19350 T153 C10 P14804 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 19351 T211 C11 P56100 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 19351 T211 C11 P56100 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19352 T211 C11 P56100 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19354 T153 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1
[junit4:junit4]   2> 19355 T153 C10 P14804 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty1/index
[junit4:junit4]   2> 19356 T153 C10 P14804 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=2 
[junit4:junit4]   2> 19357 T211 C11 P56100 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19357 T211 C11 P56100 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848 forceNew:false
[junit4:junit4]   2> 19358 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 19358 T211 C11 P56100 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848 lockFactory=org.apache.lucene.store.NativeFSLockFactory@283ed3f5; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 19362 T153 C10 P14804 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   2> 19364 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index
[junit4:junit4]   2> 19364 T211 C11 P56100 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19403 T211 C11 P56100 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203015756848
[junit4:junit4]   2> 19404 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 19405 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 19405 T211 C11 P56100 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index/ new=./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848
[junit4:junit4]   2> 19409 T211 C11 P56100 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848 lockFactory=org.apache.lucene.store.NativeFSLockFactory@283ed3f5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 19409 T211 C11 P56100 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 19410 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 19411 T211 C11 P56100 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19411 T211 C11 P56100 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 19411 T211 C11 P56100 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 19412 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848
[junit4:junit4]   2> 19413 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 19416 T211 C11 P56100 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848 lockFactory=org.apache.lucene.store.NativeFSLockFactory@283ed3f5; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 19417 T211 C11 P56100 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 19417 T211 C11 P56100 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19418 T211 C11 P56100 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 19418 T211 C11 P56100 oass.SolrIndexSearcher.<init> Opening Searcher@32426e05 main
[junit4:junit4]   2> 19420 T210 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32426e05 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 19420 T210 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test

[...truncated too long message...]

irectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index.20130203015756848
[junit4:junit4]   2> 144921 T118 oash.SnapPuller$2.postClose removing old index directory RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e680525; maxCacheMB=48.0 maxMergeSizeMB=4.0))
[junit4:junit4]   2> 144923 T118 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 144924 T118 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4
[junit4:junit4]   2> 144924 T118 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index
[junit4:junit4]   2> 144925 T118 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1359813457499/jetty4/index
[junit4:junit4]   2> 145524 T205 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53851. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 164196 T206 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 164196 T118 oaz.ZooKeeper.close Session: 0x13c9b32b664000c closed
[junit4:junit4]   2> 164199 T118 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4]   2> 164427 T118 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=F40A0CACDC58ADC6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hr_HR -Dtests.timezone=Pacific/Fiji -Dtests.file.encoding=ISO8859-1
[junit4:junit4] FAILURE  165s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([F40A0CACDC58ADC6:75EC82B4AB07CDFA]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 164566 T118 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=hr_HR, timezone=Pacific/Fiji
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=324177896,total=429654016
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestUtils, TestMultiCoreConfBootstrap, RAMDirectoryFactoryTest, TestLRUCache, HardAutoCommitTest, SynonymTokenizerTest, SolrIndexConfigTest, TestArbitraryIndexDir, PeerSyncTest, SoftAutoCommitTest, SpellingQueryConverterTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 164.60s, 1 test, 1 failure <<< FAILURES!

[...truncated 662 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:841: There were test failures: 250 suites, 1041 tests, 1 failure, 23 ignored (5 assumptions)

Total time: 36 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure