You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/01/12 05:15:26 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java6 - Build # 15809 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java6/15809/
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 should have just been set up to be inconsistent - but it's still consistent
Stack Trace:
java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
at __randomizedtesting.SeedInfo.seed([31D976A96837812F:B03FF8B11F68E113]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8198 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T160 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /dxktf/d
[junit4:junit4] 2> 5 T160 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1357963226643
[junit4:junit4] 2> 6 T160 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T161 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 9 T161 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 9 T161 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 9 T161 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 9 T161 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 10 T161 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T160 oasc.ZkTestServer.run start zk server on port:21335
[junit4:junit4] 2> 108 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f9370f0
[junit4:junit4] 2> 109 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 117 T166 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 117 T166 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 118 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:13742
[junit4:junit4] 2> 118 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:13742
[junit4:junit4] 2> 119 T164 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 121 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0000 with negotiated timeout 10000 for client /140.211.11.196:13742
[junit4:junit4] 2> 121 T166 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0000, negotiated timeout = 10000
[junit4:junit4] 2> 121 T167 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f9370f0 name:ZooKeeperConnection Watcher:127.0.0.1:21335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 122 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 122 T160 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 126 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d0000
[junit4:junit4] 2> 144 T167 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 144 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d0000 closed
[junit4:junit4] 2> 144 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:13742 which had sessionid 0x13c2cea6e1d0000
[junit4:junit4] 2> 145 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4dfbbcea
[junit4:junit4] 2> 146 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 146 T168 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 146 T168 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 147 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15045
[junit4:junit4] 2> 147 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15045
[junit4:junit4] 2> 148 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0001 with negotiated timeout 10000 for client /140.211.11.196:15045
[junit4:junit4] 2> 148 T168 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0001, negotiated timeout = 10000
[junit4:junit4] 2> 149 T169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dfbbcea name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 149 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 153 T160 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 171 T160 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 175 T160 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 179 T160 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 201 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 222 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 287 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 288 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 394 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 395 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 400 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 401 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 413 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 414 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 419 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 419 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 436 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 437 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 447 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 447 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 452 T160 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 453 T160 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 460 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d0001
[junit4:junit4] 2> 461 T169 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 461 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d0001 closed
[junit4:junit4] 2> 461 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:15045 which had sessionid 0x13c2cea6e1d0001
[junit4:junit4] 2> 620 T160 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 624 T160 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:39442
[junit4:junit4] 2> 625 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 626 T160 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 626 T160 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099
[junit4:junit4] 2> 627 T160 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/solr.xml
[junit4:junit4] 2> 628 T160 oasc.CoreContainer.<init> New CoreContainer 150513542
[junit4:junit4] 2> 629 T160 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/'
[junit4:junit4] 2> 630 T160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/'
[junit4:junit4] 2> 664 T160 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 665 T160 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 665 T160 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 666 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 666 T160 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 666 T160 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 666 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 667 T160 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 667 T160 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 667 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 687 T160 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 700 T160 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:21335/solr
[junit4:junit4] 2> 722 T160 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 722 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@591de39a
[junit4:junit4] 2> 723 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 724 T179 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 724 T179 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 725 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58987
[junit4:junit4] 2> 725 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58987
[junit4:junit4] 2> 727 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0002 with negotiated timeout 20000 for client /140.211.11.196:58987
[junit4:junit4] 2> 727 T179 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0002, negotiated timeout = 20000
[junit4:junit4] 2> 727 T180 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@591de39a name:ZooKeeperConnection Watcher:127.0.0.1:21335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 728 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 729 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d0002
[junit4:junit4] 2> 742 T180 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 742 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58987 which had sessionid 0x13c2cea6e1d0002
[junit4:junit4] 2> 742 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d0002 closed
[junit4:junit4] 2> 754 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 774 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@62b6bb33
[junit4:junit4] 2> 775 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 776 T181 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 776 T181 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 776 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45196
[junit4:junit4] 2> 777 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45196
[junit4:junit4] 2> 778 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0003 with negotiated timeout 20000 for client /140.211.11.196:45196
[junit4:junit4] 2> 778 T181 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0003, negotiated timeout = 20000
[junit4:junit4] 2> 779 T182 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62b6bb33 name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 779 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 793 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 801 T160 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 805 T160 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39442_dxktf%2Fd
[junit4:junit4] 2> 806 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39442_dxktf%2Fd Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39442_dxktf%2Fd
[junit4:junit4] 2> 812 T160 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39442_dxktf%2Fd
[junit4:junit4] 2> 818 T160 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 841 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 842 T160 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 847 T160 oasc.Overseer.start Overseer (id=88995478021931011-127.0.0.1:39442_dxktf%2Fd-n_0000000000) starting
[junit4:junit4] 2> 847 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 871 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 873 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 878 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 886 T184 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4] 2> 887 T160 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 890 T160 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 923 T183 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 935 T185 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/collection1
[junit4:junit4] 2> 935 T185 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 936 T185 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 936 T185 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 941 T185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/collection1/'
[junit4:junit4] 2> 942 T185 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/collection1/lib/README' to classloader
[junit4:junit4] 2> 942 T185 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1040 T185 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1143 T185 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1244 T185 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1273 T185 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 2088 T185 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2105 T185 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2110 T185 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2143 T185 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2150 T185 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2155 T185 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2158 T185 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2161 T185 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1357963227099/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data/
[junit4:junit4] 2> 2161 T185 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@67e2c841
[junit4:junit4] 2> 2163 T185 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 2203 T185 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data forceNew:false
[junit4:junit4] 2> 2204 T185 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data
[junit4:junit4] 2> 2204 T185 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data/index/
[junit4:junit4] 2> 2205 T185 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2206 T185 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data/index forceNew:false
[junit4:junit4] 2> 2216 T185 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@71ebfc42; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 2217 T185 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 2218 T185 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data/index
[junit4:junit4] 2> 2218 T185 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 2221 T185 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2222 T185 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 2223 T185 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2223 T185 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 2224 T185 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2224 T185 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2224 T185 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2225 T185 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2226 T185 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2226 T185 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 2227 T185 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 2227 T185 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2228 T185 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 2228 T185 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 2229 T185 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 2229 T185 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2230 T185 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2230 T185 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2231 T185 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2232 T185 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2232 T185 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2233 T185 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2233 T185 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2234 T185 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2235 T185 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 2235 T185 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 2243 T185 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2249 T185 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 2251 T185 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 2254 T185 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/control/data
[junit4:junit4] 2> 2256 T185 oass.SolrIndexSearcher.<init> Opening Searcher@4a89e2f0 main
[junit4:junit4] 2> 2257 T185 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2258 T185 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2258 T185 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 2281 T185 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 2351 T186 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a89e2f0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2363 T185 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2364 T185 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2365 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2430 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2432 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:39442_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39442/dxktf/d"}
[junit4:junit4] 2> 2432 T183 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2443 T183 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2445 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2472 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3378 T185 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3378 T185 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39442/dxktf/d collection:control_collection shard:shard1
[junit4:junit4] 2> 3384 T185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 3396 T185 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 3461 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 3462 T185 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 3463 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3465 T185 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 3466 T185 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 3471 T185 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39442/dxktf/d/collection1/
[junit4:junit4] 2> 3472 T185 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 3472 T185 oasc.SyncStrategy.syncToMe http://127.0.0.1:39442/dxktf/d/collection1/ has no replicas
[junit4:junit4] 2> 3472 T185 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39442/dxktf/d/collection1/
[junit4:junit4] 2> 3472 T185 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 3481 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3979 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4014 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4053 T185 oasc.ZkController.register We are http://127.0.0.1:39442/dxktf/d/collection1/ and leader is http://127.0.0.1:39442/dxktf/d/collection1/
[junit4:junit4] 2> 4053 T185 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39442/dxktf/d
[junit4:junit4] 2> 4053 T185 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 4054 T185 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 4054 T185 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4058 T185 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4060 T160 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 4060 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4061 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4074 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4093 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f2ceb70
[junit4:junit4] 2> 4094 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4095 T187 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4096 T187 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 4096 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47573
[junit4:junit4] 2> 4096 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47573
[junit4:junit4] 2> 4098 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0004 with negotiated timeout 10000 for client /140.211.11.196:47573
[junit4:junit4] 2> 4098 T187 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0004, negotiated timeout = 10000
[junit4:junit4] 2> 4098 T188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f2ceb70 name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4099 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4100 T160 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4105 T160 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4333 T160 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4337 T160 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:15702
[junit4:junit4] 2> 4337 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4338 T160 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4338 T160 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742
[junit4:junit4] 2> 4339 T160 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/solr.xml
[junit4:junit4] 2> 4340 T160 oasc.CoreContainer.<init> New CoreContainer 405685060
[junit4:junit4] 2> 4340 T160 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/'
[junit4:junit4] 2> 4341 T160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/'
[junit4:junit4] 2> 4408 T160 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 4408 T160 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4409 T160 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4409 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4410 T160 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4410 T160 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4411 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4411 T160 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4411 T160 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4412 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4434 T160 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4455 T160 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:21335/solr
[junit4:junit4] 2> 4456 T160 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4456 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3cd0fbe7
[junit4:junit4] 2> 4457 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4458 T198 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4459 T198 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 4459 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:51389
[junit4:junit4] 2> 4459 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:51389
[junit4:junit4] 2> 4462 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0005 with negotiated timeout 20000 for client /140.211.11.196:51389
[junit4:junit4] 2> 4462 T198 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0005, negotiated timeout = 20000
[junit4:junit4] 2> 4462 T199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cd0fbe7 name:ZooKeeperConnection Watcher:127.0.0.1:21335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4463 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4465 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d0005
[junit4:junit4] 2> 4474 T199 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4474 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51389 which had sessionid 0x13c2cea6e1d0005
[junit4:junit4] 2> 4474 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d0005 closed
[junit4:junit4] 2> 4475 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 4489 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c6cea8a
[junit4:junit4] 2> 4490 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4491 T200 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4491 T200 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 4491 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31046
[junit4:junit4] 2> 4492 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31046
[junit4:junit4] 2> 4497 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0006 with negotiated timeout 20000 for client /140.211.11.196:31046
[junit4:junit4] 2> 4497 T200 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0006, negotiated timeout = 20000
[junit4:junit4] 2> 4497 T201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c6cea8a name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4498 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4499 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4515 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4517 T160 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:15702_dxktf%2Fd
[junit4:junit4] 2> 4518 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:15702_dxktf%2Fd Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:15702_dxktf%2Fd
[junit4:junit4] 2> 4519 T160 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:15702_dxktf%2Fd
[junit4:junit4] 2> 4528 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4529 T188 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4530 T182 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4539 T160 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4550 T202 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/collection1
[junit4:junit4] 2> 4550 T202 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4551 T202 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4551 T202 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4553 T202 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/collection1/'
[junit4:junit4] 2> 4555 T202 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/collection1/lib/README' to classloader
[junit4:junit4] 2> 4555 T202 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4613 T202 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4687 T202 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4788 T202 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4810 T202 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5536 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5537 T202 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5538 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:39442_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39442/dxktf/d"}
[junit4:junit4] 2> 5553 T202 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5556 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5556 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5556 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5557 T202 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5590 T202 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5597 T202 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5603 T202 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5605 T202 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5607 T202 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1357963230742/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/
[junit4:junit4] 2> 5608 T202 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@67e2c841
[junit4:junit4] 2> 5609 T202 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 5613 T202 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1 forceNew:false
[junit4:junit4] 2> 5614 T202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 5614 T202 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index/
[junit4:junit4] 2> 5615 T202 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5616 T202 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index forceNew:false
[junit4:junit4] 2> 5623 T202 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5624 T202 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5632 T202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index
[junit4:junit4] 2> 5632 T202 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 5635 T202 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5636 T202 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 5636 T202 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5636 T202 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 5637 T202 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5638 T202 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5638 T202 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5639 T202 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5640 T202 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5641 T202 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 5642 T202 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 5642 T202 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5643 T202 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 5643 T202 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 5644 T202 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 5644 T202 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5645 T202 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5646 T202 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5647 T202 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5648 T202 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5649 T202 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5650 T202 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5650 T202 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5651 T202 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5652 T202 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 5653 T202 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 5660 T202 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5665 T202 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 5667 T202 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 5670 T202 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 5672 T202 oass.SolrIndexSearcher.<init> Opening Searcher@f7df584 main
[junit4:junit4] 2> 5673 T202 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5674 T202 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5674 T202 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 5715 T202 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 5798 T203 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f7df584 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5808 T202 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5809 T202 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7065 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7066 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:15702_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15702/dxktf/d"}
[junit4:junit4] 2> 7066 T183 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 7066 T183 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 7081 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7082 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7082 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7814 T202 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7814 T202 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:15702/dxktf/d collection:collection1 shard:shard1
[junit4:junit4] 2> 7815 T202 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7870 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7887 T202 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7888 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7975 T202 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7975 T202 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7976 T202 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:15702/dxktf/d/collection1/
[junit4:junit4] 2> 7976 T202 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7976 T202 oasc.SyncStrategy.syncToMe http://127.0.0.1:15702/dxktf/d/collection1/ has no replicas
[junit4:junit4] 2> 7976 T202 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:15702/dxktf/d/collection1/
[junit4:junit4] 2> 7977 T202 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 8032 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8603 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8624 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8624 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8624 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8636 T202 oasc.ZkController.register We are http://127.0.0.1:15702/dxktf/d/collection1/ and leader is http://127.0.0.1:15702/dxktf/d/collection1/
[junit4:junit4] 2> 8636 T202 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:15702/dxktf/d
[junit4:junit4] 2> 8636 T202 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8636 T202 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8637 T202 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8640 T202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8641 T160 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8642 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8643 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8927 T160 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8930 T160 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53164
[junit4:junit4] 2> 8931 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8931 T160 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8932 T160 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304
[junit4:junit4] 2> 8932 T160 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/solr.xml
[junit4:junit4] 2> 8933 T160 oasc.CoreContainer.<init> New CoreContainer 415321553
[junit4:junit4] 2> 8934 T160 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/'
[junit4:junit4] 2> 8934 T160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/'
[junit4:junit4] 2> 9003 T160 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 9004 T160 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 9004 T160 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 9005 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 9005 T160 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 9006 T160 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 9006 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 9006 T160 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 9007 T160 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 9007 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 9042 T160 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 9066 T160 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:21335/solr
[junit4:junit4] 2> 9066 T160 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 9067 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3993340f
[junit4:junit4] 2> 9068 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9069 T213 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 9069 T213 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 9070 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:24816
[junit4:junit4] 2> 9070 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:24816
[junit4:junit4] 2> 9072 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0007 with negotiated timeout 20000 for client /140.211.11.196:24816
[junit4:junit4] 2> 9072 T213 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0007, negotiated timeout = 20000
[junit4:junit4] 2> 9073 T214 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3993340f name:ZooKeeperConnection Watcher:127.0.0.1:21335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9073 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9075 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d0007
[junit4:junit4] 2> 9085 T214 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 9085 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:24816 which had sessionid 0x13c2cea6e1d0007
[junit4:junit4] 2> 9085 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d0007 closed
[junit4:junit4] 2> 9086 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 9099 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@75ce5af9
[junit4:junit4] 2> 9100 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9101 T215 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 9101 T215 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 9101 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:46698
[junit4:junit4] 2> 9102 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:46698
[junit4:junit4] 2> 9103 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0008 with negotiated timeout 20000 for client /140.211.11.196:46698
[junit4:junit4] 2> 9103 T215 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0008, negotiated timeout = 20000
[junit4:junit4] 2> 9103 T216 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75ce5af9 name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9104 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9105 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9107 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9119 T160 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53164_dxktf%2Fd
[junit4:junit4] 2> 9120 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d0008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53164_dxktf%2Fd Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53164_dxktf%2Fd
[junit4:junit4] 2> 9121 T160 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53164_dxktf%2Fd
[junit4:junit4] 2> 9129 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9129 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9129 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9132 T188 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9132 T182 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9133 T201 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9136 T160 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9145 T217 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/collection1
[junit4:junit4] 2> 9145 T217 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9146 T217 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9147 T217 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9149 T217 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/collection1/'
[junit4:junit4] 2> 9150 T217 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/collection1/lib/README' to classloader
[junit4:junit4] 2> 9151 T217 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9219 T217 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9311 T217 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9412 T217 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9435 T217 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10130 T217 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10136 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10137 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:15702_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15702/dxktf/d"}
[junit4:junit4] 2> 10145 T217 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10149 T217 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10154 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10154 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10154 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10154 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10181 T217 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10187 T217 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10193 T217 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10195 T217 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10197 T217 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1357963235304/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/
[junit4:junit4] 2> 10198 T217 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@67e2c841
[junit4:junit4] 2> 10198 T217 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 10206 T217 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2 forceNew:false
[junit4:junit4] 2> 10207 T217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 10207 T217 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index/
[junit4:junit4] 2> 10212 T217 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10213 T217 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index forceNew:false
[junit4:junit4] 2> 10219 T217 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ff065d8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10219 T217 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10226 T217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index
[junit4:junit4] 2> 10226 T217 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 10229 T217 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10229 T217 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 10230 T217 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10230 T217 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 10231 T217 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10231 T217 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10231 T217 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10232 T217 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10233 T217 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10234 T217 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 10234 T217 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 10235 T217 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10236 T217 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 10236 T217 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 10236 T217 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 10237 T217 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10238 T217 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10239 T217 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10239 T217 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10240 T217 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10241 T217 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10242 T217 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10242 T217 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10243 T217 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10244 T217 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 10245 T217 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 10255 T217 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10260 T217 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 10262 T217 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 10265 T217 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 10266 T217 oass.SolrIndexSearcher.<init> Opening Searcher@2dc68dc6 main
[junit4:junit4] 2> 10267 T217 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10268 T217 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10268 T217 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 10305 T217 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 10412 T218 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dc68dc6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10422 T217 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10422 T217 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11662 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11663 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53164_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53164/dxktf/d"}
[junit4:junit4] 2> 11663 T183 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11663 T183 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11690 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11690 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11690 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11690 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12426 T217 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12426 T217 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53164/dxktf/d collection:collection1 shard:shard1
[junit4:junit4] 2> 12432 T217 oasc.ZkController.register We are http://127.0.0.1:53164/dxktf/d/collection1/ and leader is http://127.0.0.1:15702/dxktf/d/collection1/
[junit4:junit4] 2> 12432 T217 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53164/dxktf/d
[junit4:junit4] 2> 12432 T217 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 12432 T217 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@784a2d5e url=http://127.0.0.1:53164/dxktf/d/collection1 node=127.0.0.1:53164_dxktf%2Fd C7_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53164_dxktf%2Fd, base_url=http://127.0.0.1:53164/dxktf/d}
[junit4:junit4] 2> 12444 T219 C7 P53164 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 12445 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 12445 T219 C7 P53164 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 12445 T217 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12445 T219 C7 P53164 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12447 T160 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12447 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12448 T219 C7 P53164 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12448 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12802 T160 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12805 T160 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32915
[junit4:junit4] 2> 12806 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12806 T160 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12807 T160 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108
[junit4:junit4] 2> 12807 T160 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/solr.xml
[junit4:junit4] 2> 12808 T160 oasc.CoreContainer.<init> New CoreContainer 997885503
[junit4:junit4] 2> 12808 T160 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/'
[junit4:junit4] 2> 12809 T160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/'
[junit4:junit4] 2> 12853 T160 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 12854 T160 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12854 T160 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12855 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12855 T160 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12855 T160 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12856 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12856 T160 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12857 T160 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12857 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12881 T160 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12900 T160 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:21335/solr
[junit4:junit4] 2> 12901 T160 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12901 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1085d94
[junit4:junit4] 2> 12903 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12903 T229 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 12904 T229 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 12905 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32439
[junit4:junit4] 2> 12905 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32439
[junit4:junit4] 2> 12940 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d0009 with negotiated timeout 20000 for client /140.211.11.196:32439
[junit4:junit4] 2> 12940 T229 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d0009, negotiated timeout = 20000
[junit4:junit4] 2> 12940 T230 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1085d94 name:ZooKeeperConnection Watcher:127.0.0.1:21335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12940 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12942 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d0009
[junit4:junit4] 2> 12977 T230 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12977 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:32439 which had sessionid 0x13c2cea6e1d0009
[junit4:junit4] 2> 12977 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d0009 closed
[junit4:junit4] 2> 12978 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 12991 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@49ef12fb
[junit4:junit4] 2> 12992 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12992 T231 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 12993 T231 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 12993 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55092
[junit4:junit4] 2> 12994 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55092
[junit4:junit4] 2> 12996 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d000a with negotiated timeout 20000 for client /140.211.11.196:55092
[junit4:junit4] 2> 12996 T231 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d000a, negotiated timeout = 20000
[junit4:junit4] 2> 12996 T232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49ef12fb name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12996 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12997 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d000a type:create cxid:0x1 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13043 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d000a type:create cxid:0x2 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13046 T160 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32915_dxktf%2Fd
[junit4:junit4] 2> 13047 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d000a type:delete cxid:0x4 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32915_dxktf%2Fd Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32915_dxktf%2Fd
[junit4:junit4] 2> 13054 T160 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32915_dxktf%2Fd
[junit4:junit4] 2> 13058 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13058 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13058 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13058 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13061 T201 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13062 T182 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13062 T188 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13119 T216 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13122 T160 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13129 T233 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/collection1
[junit4:junit4] 2> 13130 T233 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13131 T233 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13131 T233 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13133 T233 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/collection1/'
[junit4:junit4] 2> 13144 T233 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/collection1/lib/README' to classloader
[junit4:junit4] 2> 13145 T233 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13199 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13200 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53164_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53164/dxktf/d"}
[junit4:junit4] 2> 13226 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13226 T232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13227 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13226 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13226 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13239 T233 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 13344 T233 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13445 T233 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13460 T233 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14245 T233 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14261 T233 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14265 T233 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14296 T233 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14322 T233 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14329 T233 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14331 T233 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14334 T233 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1357963239108/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/
[junit4:junit4] 2> 14334 T233 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@67e2c841
[junit4:junit4] 2> 14335 T233 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14341 T233 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3 forceNew:false
[junit4:junit4] 2> 14342 T233 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 14343 T233 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index/
[junit4:junit4] 2> 14344 T233 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14345 T233 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index forceNew:false
[junit4:junit4] 2> 14381 T233 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ca24fe7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14382 T233 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14410 T233 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index
[junit4:junit4] 2> 14411 T233 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 14414 T233 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14415 T233 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 14415 T233 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14415 T233 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 14416 T233 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14416 T233 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14417 T233 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14418 T233 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14418 T233 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14419 T233 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 14420 T233 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 14420 T233 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14421 T233 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 14421 T233 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 14422 T233 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 14423 T233 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14423 T233 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14424 T233 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14425 T233 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14426 T233 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14426 T233 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14427 T233 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14428 T233 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14429 T233 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 14429 T233 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 14430 T233 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 14437 T233 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14442 T233 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 14444 T233 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 14446 T233 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 14448 T233 oass.SolrIndexSearcher.<init> Opening Searcher@32213b6e main
[junit4:junit4] 2> 14460 T233 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14461 T233 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14461 T233 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 14480 T233 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 14615 T234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32213b6e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14625 T233 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14625 T233 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14735 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14736 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:32915_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32915/dxktf/d"}
[junit4:junit4] 2> 14736 T183 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 14736 T183 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 14744 T232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14745 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14745 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14745 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14745 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> C7_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53164_dxktf%2Fd, base_url=http://127.0.0.1:53164/dxktf/d}
[junit4:junit4] 2> 15505 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:15702/dxktf/d/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15517 T219 C7 P53164 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 15542 T219 C7 P53164 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53164/dxktf/d START replicas=[http://127.0.0.1:15702/dxktf/d/collection1/] nUpdates=100
[junit4:junit4] 2> 15543 T219 C7 P53164 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15543 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15544 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15544 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15544 T219 C7 P53164 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 15545 T219 C7 P53164 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:15702/dxktf/d/collection1/. core=collection1
[junit4:junit4] 2> 15545 T219 C7 P53164 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@4d98c155 url=http://127.0.0.1:15702/dxktf/d/collection1 node=127.0.0.1:15702_dxktf%2Fd C8_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:15702_dxktf%2Fd, base_url=http://127.0.0.1:15702/dxktf/d, leader=true}
[junit4:junit4] 2> 15561 T192 C8 P15702 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 15578 T193 C8 P15702 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 15580 T193 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 15586 T193 C8 P15702 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15586 T193 C8 P15702 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15605 T193 C8 P15702 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15606 T193 C8 P15702 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15614 T193 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 15614 T193 C8 P15702 oass.SolrIndexSearcher.<init> Opening Searcher@460d1277 realtime
[junit4:junit4] 2> 15614 T193 C8 P15702 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15615 T193 C8 P15702 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 52
[junit4:junit4] 2> 15629 T233 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 15629 T233 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32915/dxktf/d collection:collection1 shard:shard1
[junit4:junit4] 2> 15636 T233 oasc.ZkController.register We are http://127.0.0.1:32915/dxktf/d/collection1/ and leader is http://127.0.0.1:15702/dxktf/d/collection1/
[junit4:junit4] 2> 15636 T233 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32915/dxktf/d
[junit4:junit4] 2> 15636 T233 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 15636 T233 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@23c89df9 url=http://127.0.0.1:32915/dxktf/d/collection1 node=127.0.0.1:32915_dxktf%2Fd C9_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:32915_dxktf%2Fd, base_url=http://127.0.0.1:32915/dxktf/d}
[junit4:junit4] 2> 15637 T236 C9 P32915 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 15638 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 15638 T233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15638 T236 C9 P32915 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 15638 T236 C9 P32915 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15639 T160 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 15640 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 15640 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15641 T236 C9 P32915 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15720 T219 C7 P53164 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15720 T219 C7 P53164 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 15748 T219 C7 P53164 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15757 T195 C8 P15702 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15758 T195 C8 P15702 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 15759 T219 C7 P53164 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15759 T219 C7 P53164 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15760 T219 C7 P53164 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15763 T195 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 15764 T195 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index
[junit4:junit4] 2> 15764 T195 C8 P15702 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 15765 T219 C7 P53164 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 15775 T219 C7 P53164 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402 forceNew:false
[junit4:junit4] 2> 15776 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15782 T219 C7 P53164 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc69e6a; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 15797 T195 C8 P15702 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5
[junit4:junit4] 2> 15817 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index
[junit4:junit4] 2> 15817 T219 C7 P53164 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15819 T219 C7 P53164 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130112080042402
[junit4:junit4] 2> 15826 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15826 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15827 T219 C7 P53164 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402
[junit4:junit4] 2> 15835 T219 C7 P53164 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc69e6a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15836 T219 C7 P53164 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15837 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15845 T219 C7 P53164 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15845 T219 C7 P53164 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15845 T219 C7 P53164 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 15851 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402
[junit4:junit4] 2> 15852 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15857 T219 C7 P53164 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc69e6a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15857 T219 C7 P53164 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15857 T219 C7 P53164 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15858 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15858 T219 C7 P53164 oass.SolrIndexSearcher.<init> Opening Searcher@65510241 main
[junit4:junit4] 2> 15861 T218 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65510241 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 15862 T218 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index
[junit4:junit4] 2> 15862 T219 C7 P53164 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 15866 T219 C7 P53164 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc69e6a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc69e6a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 15866 T219 C7 P53164 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 15873 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2
[junit4:junit4] 2> 15873 T219 C7 P53164 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15874 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index.20130112080042402
[junit4:junit4] 2> 15874 T219 C7 P53164 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty2/index
[junit4:junit4] 2> 15874 T219 C7 P53164 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 15874 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15874 T219 C7 P53164 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15875 T219 C7 P53164 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15877 T219 C7 P53164 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15894 T160 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 15897 T160 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34311
[junit4:junit4] 2> 15897 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 15898 T160 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 15898 T160 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301
[junit4:junit4] 2> 15899 T160 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/solr.xml
[junit4:junit4] 2> 15899 T160 oasc.CoreContainer.<init> New CoreContainer 79123022
[junit4:junit4] 2> 15900 T160 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/'
[junit4:junit4] 2> 15900 T160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/'
[junit4:junit4] 2> 15950 T160 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 15951 T160 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 15951 T160 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 15952 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 15952 T160 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 15952 T160 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 15953 T160 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 15953 T160 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 15954 T160 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 15954 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 15979 T160 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16003 T160 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:21335/solr
[junit4:junit4] 2> 16003 T160 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16004 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@270cf661
[junit4:junit4] 2> 16005 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16006 T247 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 16006 T247 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 16007 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49244
[junit4:junit4] 2> 16007 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49244
[junit4:junit4] 2> 16009 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d000b with negotiated timeout 20000 for client /140.211.11.196:49244
[junit4:junit4] 2> 16009 T247 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d000b, negotiated timeout = 20000
[junit4:junit4] 2> 16010 T248 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@270cf661 name:ZooKeeperConnection Watcher:127.0.0.1:21335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16010 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16012 T165 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c2cea6e1d000b
[junit4:junit4] 2> 16013 T248 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16014 T162 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49244 which had sessionid 0x13c2cea6e1d000b
[junit4:junit4] 2> 16013 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d000b closed
[junit4:junit4] 2> 16014 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 16032 T160 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:21335/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e512035
[junit4:junit4] 2> 16033 T160 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16033 T249 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:21335. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 16034 T249 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:21335, initiating session
[junit4:junit4] 2> 16034 T162 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:13729
[junit4:junit4] 2> 16035 T162 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:13729
[junit4:junit4] 2> 16036 T164 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c2cea6e1d000c with negotiated timeout 20000 for client /140.211.11.196:13729
[junit4:junit4] 2> 16036 T249 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:21335, sessionid = 0x13c2cea6e1d000c, negotiated timeout = 20000
[junit4:junit4] 2> 16037 T250 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e512035 name:ZooKeeperConnection Watcher:127.0.0.1:21335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16037 T160 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16038 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16040 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16053 T160 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34311_dxktf%2Fd
[junit4:junit4] 2> 16054 T165 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c2cea6e1d000c type:delete cxid:0x4 zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34311_dxktf%2Fd Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34311_dxktf%2Fd
[junit4:junit4] 2> 16056 T160 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34311_dxktf%2Fd
[junit4:junit4] 2> 16059 T232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16059 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16059 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16059 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16059 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16063 T188 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16063 T216 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16063 T232 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16063 T201 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16077 T182 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16080 T160 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 16092 T251 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/collection1
[junit4:junit4] 2> 16092 T251 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 16093 T251 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 16094 T251 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 16096 T251 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/collection1/'
[junit4:junit4] 2> 16097 T251 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/collection1/lib/README' to classloader
[junit4:junit4] 2> 16097 T251 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 16168 T251 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 16271 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16271 T251 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16272 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:32915_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32915/dxktf/d"}
[junit4:junit4] 2> 16283 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53164_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53164/dxktf/d"}
[junit4:junit4] 2> 16319 T232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16319 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16319 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16319 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16319 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16372 T251 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16372 T250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16388 T251 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17063 T251 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17079 T251 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17083 T251 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17113 T251 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17119 T251 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17124 T251 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17126 T251 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17128 T251 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1357963242301/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/
[junit4:junit4] 2> 17128 T251 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@67e2c841
[junit4:junit4] 2> 17129 T251 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17130 T251 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4 forceNew:false
[junit4:junit4] 2> 17131 T251 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 17131 T251 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index/
[junit4:junit4] 2> 17131 T251 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17132 T251 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index forceNew:false
[junit4:junit4] 2> 17139 T251 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a176fbb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17139 T251 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17153 T251 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index
[junit4:junit4] 2> 17153 T251 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 17156 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17157 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 17157 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17157 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 17158 T251 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17158 T251 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17159 T251 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17160 T251 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17161 T251 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17161 T251 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 17162 T251 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 17163 T251 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17163 T251 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 17164 T251 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 17164 T251 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 17165 T251 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17166 T251 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17166 T251 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17167 T251 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17168 T251 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17169 T251 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17169 T251 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17170 T251 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17171 T251 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17172 T251 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 17173 T251 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 17180 T251 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17184 T251 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 17186 T251 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 17188 T251 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 17190 T251 oass.SolrIndexSearcher.<init> Opening Searcher@348f4ec main
[junit4:junit4] 2> 17191 T251 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17191 T251 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17192 T251 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 17212 T251 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 17288 T252 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@348f4ec main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17303 T251 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17303 T251 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17832 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17833 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34311_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34311/dxktf/d"}
[junit4:junit4] 2> 17833 T183 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 17833 T183 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17858 T232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17858 T250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17858 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17858 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17858 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17858 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18307 T251 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18307 T251 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34311/dxktf/d collection:collection1 shard:shard1
[junit4:junit4] 2> 18314 T251 oasc.ZkController.register We are http://127.0.0.1:34311/dxktf/d/collection1/ and leader is http://127.0.0.1:15702/dxktf/d/collection1/
[junit4:junit4] 2> 18314 T251 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34311/dxktf/d
[junit4:junit4] 2> 18315 T251 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18315 T251 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@5c2f4f8b url=http://127.0.0.1:34311/dxktf/d/collection1 node=127.0.0.1:34311_dxktf%2Fd C10_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:34311_dxktf%2Fd, base_url=http://127.0.0.1:34311/dxktf/d}
[junit4:junit4] 2> 18315 T253 C10 P34311 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18316 T253 C10 P34311 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18316 T253 C10 P34311 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18316 T251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18316 T253 C10 P34311 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18318 T160 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18318 T160 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18318 T253 C10 P34311 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18319 T160 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18338 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18340 T160 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 18341 T160 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 18342 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C9_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:32915_dxktf%2Fd, base_url=http://127.0.0.1:32915/dxktf/d}
[junit4:junit4] 2> 18669 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:15702/dxktf/d/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18669 T236 C9 P32915 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:32915/dxktf/d START replicas=[http://127.0.0.1:15702/dxktf/d/collection1/] nUpdates=100
[junit4:junit4] 2> 18670 T236 C9 P32915 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18670 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18670 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18671 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18671 T236 C9 P32915 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18671 T236 C9 P32915 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:15702/dxktf/d/collection1/. core=collection1
[junit4:junit4] 2> 18671 T236 C9 P32915 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18673 T192 C8 P15702 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18688 T197 C8 P15702 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18730 T197 C8 P15702 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18730 T197 C8 P15702 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18731 T197 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 18731 T197 C8 P15702 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18732 T197 C8 P15702 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 45
[junit4:junit4] 2> 18733 T236 C9 P32915 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18733 T236 C9 P32915 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18737 T195 C8 P15702 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 18737 T236 C9 P32915 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 18738 T236 C9 P32915 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18738 T236 C9 P32915 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18741 T195 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 18741 T195 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index
[junit4:junit4] 2> 18742 T195 C8 P15702 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=2
[junit4:junit4] 2> 18743 T236 C9 P32915 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18747 T236 C9 P32915 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380 forceNew:false
[junit4:junit4] 2> 18747 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18748 T236 C9 P32915 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c8b3e08; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 18751 T195 C8 P15702 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 18753 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index
[junit4:junit4] 2> 18754 T236 C9 P32915 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18755 T236 C9 P32915 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130112080045380
[junit4:junit4] 2> 18756 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18757 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18757 T236 C9 P32915 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380
[junit4:junit4] 2> 18761 T236 C9 P32915 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c8b3e08; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18761 T236 C9 P32915 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18763 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18763 T236 C9 P32915 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18763 T236 C9 P32915 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18763 T236 C9 P32915 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 18770 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380
[junit4:junit4] 2> 18771 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18774 T236 C9 P32915 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c8b3e08; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18775 T236 C9 P32915 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18775 T236 C9 P32915 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18776 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18776 T236 C9 P32915 oass.SolrIndexSearcher.<init> Opening Searcher@f06e01a main
[junit4:junit4] 2> 18779 T234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f06e01a main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 18779 T234 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index
[junit4:junit4] 2> 18780 T236 C9 P32915 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18783 T236 C9 P32915 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c8b3e08; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c8b3e08; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 18783 T236 C9 P32915 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 18798 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3
[junit4:junit4] 2> 18798 T236 C9 P32915 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18798 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index.20130112080045380
[junit4:junit4] 2> 18798 T236 C9 P32915 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty3/index
[junit4:junit4] 2> 18799 T236 C9 P32915 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18799 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18799 T236 C9 P32915 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18799 T236 C9 P32915 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18801 T236 C9 P32915 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19345 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19367 T183 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19370 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:34311_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34311/dxktf/d"}
[junit4:junit4] 2> 19377 T183 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:32915_dxktf%2Fd",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32915/dxktf/d"}
[junit4:junit4] 2> 19399 T232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19399 T182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19399 T216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19399 T201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19399 T188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19399 T250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20348 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21351 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C10_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:34311_dxktf%2Fd, base_url=http://127.0.0.1:34311/dxktf/d}
[junit4:junit4] 2> 22343 T253 C10 P34311 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:15702/dxktf/d/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22343 T253 C10 P34311 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34311/dxktf/d START replicas=[http://127.0.0.1:15702/dxktf/d/collection1/] nUpdates=100
[junit4:junit4] 2> 22344 T253 C10 P34311 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22344 T253 C10 P34311 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22344 T253 C10 P34311 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22344 T253 C10 P34311 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22344 T253 C10 P34311 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22345 T253 C10 P34311 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:15702/dxktf/d/collection1/. core=collection1
[junit4:junit4] 2> 22345 T253 C10 P34311 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 22347 T192 C8 P15702 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 22354 T160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22367 T191 C8 P15702 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 22380 T191 C8 P15702 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20de42ca; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 22381 T191 C8 P15702 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 22381 T191 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 22382 T191 C8 P15702 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22382 T191 C8 P15702 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4] 2> 22384 T253 C10 P34311 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22384 T253 C10 P34311 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22387 T195 C8 P15702 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 22388 T253 C10 P34311 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 22388 T253 C10 P34311 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22388 T253 C10 P34311 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22395 T195 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1
[junit4:junit4] 2> 22396 T195 C8 P15702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty1/index
[junit4:junit4] 2> 22396 T195 C8 P15702 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=6
[junit4:junit4] 2> 22397 T253 C10 P34311 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22404 T253 C10 P34311 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index.20130112080049034 forceNew:false
[junit4:junit4] 2> 22405 T253 C10 P34311 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 22406 T253 C10 P34311 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index.20130112080049034 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d3bc476; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 22409 T195 C8 P15702 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 22411 T253 C10 P34311 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index
[junit4:junit4] 2> 22411 T253 C10 P34311 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22412 T253 C10 P34311 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130112080049034
[junit4:junit4] 2> 22414 T253 C10 P34311 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 22414 T253 C10 P34311 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 22414 T253 C10 P34311 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index/ new=./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index.20130112080049034
[junit4:junit4] 2> 22418 T253 C10 P34311 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index.20130112080049034 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d3bc476; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 22418 T253 C10 P34311 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 22420 T253 C10 P34311 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 22420 T253 C10 P34311 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22420 T253 C10 P34311 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22420 T253 C10 P34311 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:jun
[...truncated too long message...]
080049034
[junit4:junit4] 2> 155840 T160 oash.SnapPuller$2.postClose removing old index directory RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a176fbb; maxCacheMB=48.0 maxMergeSizeMB=4.0))
[junit4:junit4] 2> 155841 T160 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 155842 T160 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4
[junit4:junit4] 2> 155842 T160 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index
[junit4:junit4] 2> 155842 T160 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1357963226643/jetty4/index
[junit4:junit4] 2> 156380 T250 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 156380 T160 oaz.ZooKeeper.close Session: 0x13c2cea6e1d000c closed
[junit4:junit4] 2> 156382 T160 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/dxktf/d,null}
[junit4:junit4] 2> 156901 T160 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=31D976A96837812F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=uk_UA -Dtests.timezone=Etc/GMT-4 -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 157s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([31D976A96837812F:B03FF8B11F68E113]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> 157080 T160 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41: {range_facet_l=PostingsFormat(name=Asserting), text=MockFixedIntBlock(blockSize=472), _version_=PostingsFormat(name=MockRandom), rnd_b=Lucene41(blocksize=128), intDefault=PostingsFormat(name=MockRandom), id=Lucene41(blocksize=128), timestamp=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), range_facet_sl=Lucene41(blocksize=128), range_facet_si=PostingsFormat(name=Asserting), other_tl1=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=Asserting), a_si=PostingsFormat(name=MockRandom)}, sim=DefaultSimilarity, locale=uk_UA, timezone=Etc/GMT-4
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=283666176,total=475201536
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestHashPartitioner, EchoParamsTest, SolrIndexConfigTest, ZkSolrClientTest, DistributedQueryElevationComponentTest, TestStressRecovery, DebugComponentTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 157.11s, 1 test, 1 failure <<< FAILURES!
[...truncated 587 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:344: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:841: There were test failures: 246 suites, 1029 tests, 1 failure, 23 ignored (5 assumptions)
Total time: 37 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure